-- Logs begin at Sat 2022-09-24 18:50:02 UTC, end at Sat 2022-09-24 19:47:36 UTC. -- Sep 24 19:16:56.400490 dv-osbrick-859195-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Sep 24 19:16:56.408088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 24 19:16:56.410131 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 24 19:16:56 2022] *** Sep 24 19:16:56.410131 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 24 19:16:56.410131 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 24 19:16:56.410131 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: nodename: dv-osbrick-859195-1-iscsi Sep 24 19:16:56.410131 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: machine: x86_64 Sep 24 19:16:56.410131 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: clock source: unix Sep 24 19:16:56.410131 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: pcre jit disabled Sep 24 19:16:56.410642 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: detected number of CPU cores: 4 Sep 24 19:16:56.410642 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: current working directory: / Sep 24 19:16:56.410642 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: detected binary path: /usr/bin/uwsgi-core Sep 24 19:16:56.410642 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: your processes number limit is 47680 Sep 24 19:16:56.410642 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: your memory page size is 4096 bytes Sep 24 19:16:56.410642 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: detected max file descriptor number: 2048 Sep 24 19:16:56.410642 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: lock engine: pthread robust mutexes Sep 24 19:16:56.410642 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: thunder lock: enabled Sep 24 19:16:56.410642 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 24 19:16:56.410642 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 24 19:16:56.454375 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: Python main interpreter initialized at 0x55ad90b619c0 Sep 24 19:16:56.454375 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: python threads support enabled Sep 24 19:16:56.454375 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: your server socket listen backlog is limited to 100 connections Sep 24 19:16:56.454375 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: your mercy for graceful operations on workers is 90 seconds Sep 24 19:16:56.454748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: mapped 403077 bytes (393 KB) for 2 cores Sep 24 19:16:56.454880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: *** Operational MODE: preforking *** Sep 24 19:16:56.455158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: *** uWSGI is running in multiple interpreter mode *** Sep 24 19:16:56.455158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: spawned uWSGI master process (pid: 81407) Sep 24 19:16:56.455362 dv-osbrick-859195-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Sep 24 19:16:56.456460 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: spawned uWSGI worker 1 (pid: 81420, cores: 1) Sep 24 19:16:56.456460 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: spawned uWSGI worker 2 (pid: 81421, cores: 1) Sep 24 19:16:56.456460 dv-osbrick-859195-1-iscsi devstack@keystone.service[81407]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 24 19:17:00.830640 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 19:17:00.830640 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: from cryptography.utils import int_from_bytes Sep 24 19:17:00.831454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 19:17:00.831454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: from cryptography.utils import int_from_bytes Sep 24 19:17:00.837488 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 19:17:00.837488 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: from cryptography.utils import int_from_bytes Sep 24 19:17:00.837953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 19:17:00.837953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: from cryptography.utils import int_from_bytes Sep 24 19:17:00.881730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 19:17:00.881923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 19:17:00.882117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] command line args: [] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 19:17:00.882394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 19:17:00.882574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ================================================================================ {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 19:17:00.882847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] admin_token = **** {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.883103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] config_dir = [] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.883295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.883486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] config_source = [] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.883694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] debug = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.883879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.884761 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.884761 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.884761 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.884984 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.885152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] list_limit = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.885307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] log_config_append = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.885473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.885558 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 19:17:00.885657 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] log_dir = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.885771 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 19:17:00.885850 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] log_file = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.885922 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] command line args: [] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 19:17:00.886068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.886165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 19:17:00.886274 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ================================================================================ {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 19:17:00.886375 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.886527 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] admin_token = **** {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.886622 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.886772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] config_dir = [] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.886908 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.886996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.887067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.887153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] config_source = [] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.887259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.887347 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] debug = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.887426 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.887531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.887647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.887796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.887921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.888557 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.888737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.888982 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.889116 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.889241 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.889387 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.889500 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.889612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] list_limit = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.889747 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.889861 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] log_config_append = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.889974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.890109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.890217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] log_dir = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.890376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] log_file = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.890491 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.890643 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.890751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] publish_errors = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.890892 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.890999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.891145 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.891260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.891368 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.891506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.891613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.891695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.891807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.891892 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.892001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.892082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] standard_threads = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.892160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.892237 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.892313 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.892436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.892517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.892588 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.892658 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.892733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] use_journal = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.892859 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.892947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] use_json = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.893073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] use_stderr = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.893173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.893247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] use_syslog = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.893324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.893451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.893608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.893713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.893959 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.894136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.894226 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.894320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] publish_errors = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.894451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.894534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.894705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.894792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.894954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.895040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.895202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.895280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.895434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.895519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.895669 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] standard_threads = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.895746 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.895906 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.895983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.896148 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.896226 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.896323 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.896401 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.896497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] use_journal = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.896620 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.896707 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] use_json = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.896830 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] use_stderr = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.896906 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.897002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] use_syslog = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.897154 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.897242 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:17:00.897323 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.897472 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.897549 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.897708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.897788 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.897964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.898051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.898204 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.898532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.898703 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.898782 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.898965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.899061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.899212 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.899290 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.899446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.899524 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.899691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.899778 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.899934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.900012 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.900175 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.900258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.900451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.900540 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.900637 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.900721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.900871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.900948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.901114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.901193 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.901346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.901429 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.901577 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.901659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.901823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.901901 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.902071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.902146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.902310 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.902386 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.902542 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.902619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.902782 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.902876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.903047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.903141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.903287 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.903366 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.903582 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.903659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.903939 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.904015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.904218 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.904375 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.904633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.904711 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.904869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.904946 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.905117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.905202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.905350 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.905426 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.905580 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.905656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.905814 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.905891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.906056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.906134 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.906298 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.906381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.906529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.906602 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.906760 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.906897 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.907016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.907104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.907250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.907330 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.907482 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.907561 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.907710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.907787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.907936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.908014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.908164 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.908238 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.908393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.908460 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.908626 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.908694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.908868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.908934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.909092 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.909172 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.909430 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.909687 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.909835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.910001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.910120 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.910229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.910379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.910511 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.910649 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.910756 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.910907 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.911045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.911163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.911305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.911414 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.911522 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.911664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.911779 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.911913 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.912037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.912146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.912288 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.912397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.912504 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.912639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.912758 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.912867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.913003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.913110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.913217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.913352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.913471 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.913588 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.913726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.913833 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.913939 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.914046 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.914164 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.914270 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.914345 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.914416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.914523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.914596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.914676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.914749 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.914855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.914936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.915008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.915079 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.915162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.915236 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.915306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.915377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.915377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.915519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.915637 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.915710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.915859 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.915944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.916096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.916176 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.916335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.916415 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.916569 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.916647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.916801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.916878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.917037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.917118 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.917273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.917351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.917504 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.917589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.917737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.917817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.917961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.918039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.918198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.918284 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.918450 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.918538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.918692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.918777 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.918952 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.919032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.919240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.919378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.919643 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.919764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.919921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] auth.external = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.920063 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.920194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.920321 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.920437 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.920601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.920720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.920925 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.921041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] auth.password = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.921168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.921284 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] auth.token = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.921399 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.921513 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.921634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.921781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.921910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.922027 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.922151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.922267 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.922382 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.922502 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.922618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.922733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.922883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.923004 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.923119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.923242 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] credential.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.923358 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.923473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.923600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.923717 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.923833 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] auth.external = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.923949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.924064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.924179 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.924302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.924428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.924544 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.924666 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.924782 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] auth.password = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.924898 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.925022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] auth.token = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.925022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.925238 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.925353 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.925467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.925582 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.925705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.925828 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.925943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.926060 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.926174 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.926301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.926426 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.926542 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.926664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.926781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] credential.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.926910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.927026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.927154 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] federation.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.927272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.927387 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.927502 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.927617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.927732 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.927855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.927977 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.928093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.928208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.928323 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.928447 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.928563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.928678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.928792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.928907 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.929012 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.929167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.929284 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.929400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.929514 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.929635 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.929751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.929875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.929999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.930115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.930237 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.930357 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.930473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.930633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] federation.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.930752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.930910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.931028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.931143 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.931259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.931386 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.931504 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.931637 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.931752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.931876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.931992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.932180 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.932300 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.932422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.932543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.932658 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.932773 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.932896 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.933012 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.933127 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.933241 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.933357 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.933479 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.933604 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.933720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.933835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.933951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.934066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.934181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.934304 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.934422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.934537 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.934653 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.935263 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.935384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.935514 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.935631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.935792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.935911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.936033 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.936149 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.936149 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.936375 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.936497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.936614 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.936729 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.936729 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.936953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.937068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.937183 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.937298 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.937413 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.937527 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.937652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.937768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.937883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.937997 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.938118 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.938241 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.938364 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.938481 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.938597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.938712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.938885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.939018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.939137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.939252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.939366 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.939481 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.939595 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.939720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.939836 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.939952 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.940073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.940189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.940304 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.940428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.940544 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.940544 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.940798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.940913 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.941028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.941151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.941267 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.941382 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.941497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.941612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.941727 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.941851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.941976 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.942092 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.942207 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.942321 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.942439 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.942563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.942679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.942795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.942922 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.943037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.943152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.943280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.943397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.943512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.943627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.943742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.943858 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.943982 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.944105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.944221 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.944336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.944451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.944566 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.944689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.944806 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.944922 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.945037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.945152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.945266 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.945394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.945512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.945627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.945742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.945864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.945981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.946105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.946222 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.946338 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.946453 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.946568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.946683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.946807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.946967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.947083 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.947197 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.947312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.947427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.947554 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.947672 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.947786 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.947901 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.948016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.948131 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.948255 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.948372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.948487 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.948602 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.948717 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.948832 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.948956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.949073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.949189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.949304 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.949419 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.949534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.949657 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.949774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.949889 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.950004 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.950119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.950234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.950357 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.950505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.951181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.951300 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.951415 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.951545 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.951726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.951849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.951965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.952080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] resource.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.952080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.952297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.952425 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.952541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.952656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.952770 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.952885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.952999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.953123 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.953239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.953355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.953469 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.953584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.953699 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.953822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.953939 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.954054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.954168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.954282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] role.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.954407 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.954523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] role.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.954645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.954761 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.954914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.955031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.955159 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.955276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.955394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.955508 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.955623 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.955737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.955929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] resource.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.956047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.956163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.956278 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.956394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.956510 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.956633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.956750 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.956865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.956979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.957094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.957209 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.957332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.957448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.957565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.957680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.957794 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.957909 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.958032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.958032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] role.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.958248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.958363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] role.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.958478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.958594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.958717 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.958848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.958967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.959081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.959196 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.959311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.959438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.959556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.959672 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.959788 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.959904 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.960019 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.960143 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.960267 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.960384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.960500 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.960615 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.960731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.960854 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.960971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.961086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.961237 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.961354 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.961478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.961594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.961710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.961824 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.961938 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.962052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.962174 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.962293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.962409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.962523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.962637 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.962752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] token.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.962917 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.963035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.963149 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.963263 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.963377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.963491 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.963614 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.963730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.963845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.963960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.964074 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.964188 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.964311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.964427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.964541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.964655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.964768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.964884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.965007 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.965122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.965237 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.965351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.965465 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.965579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.965701 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.965817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.965931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.966105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.966238 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.966404 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.966579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] token.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.966730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.966865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.966995 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.967111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.967225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] database.connection = **** {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.967339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.967462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.967462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.967678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.967792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.967792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.968007 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.968130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.968246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.968360 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.968475 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.968475 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.968688 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.968810 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.968926 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.969041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.969155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.969270 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.969384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.969507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.969622 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.969737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.969850 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.969965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.970080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.970203 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.970327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.970458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.970575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.970690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.970805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.970964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] database.connection = **** {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.971081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.971210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.971360 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.971360 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 19:17:00.971579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.971579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.971579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.971579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.971579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.972105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.972105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.972105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.972426 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.972572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.972805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.973050 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.973284 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.973534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.973762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.973999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.974233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:17:00.974400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 19:17:01.000440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.000672 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.000898 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.005244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.005478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.005705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.009336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.014970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.038529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.038759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.041151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.041383 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.092747 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.094566 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.142746 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.143008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.143789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.144023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.213487 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.213691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.213882 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.214099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.214316 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.214530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.299378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.299630 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.299843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.300063 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.300282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.300499 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.317040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.317271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.317500 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.317722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.317939 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.318152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.318364 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.331253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.333256 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.333484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.333708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.333928 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.334145 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.334358 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.334572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.343443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.344760 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.344998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.345226 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.345447 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.345664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.345880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.346097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.346177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.346370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.346592 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.346810 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.347051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.347266 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.347475 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:17:01.362807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.363045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 19:17:01.363391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.363474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.363596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 19:17:01.363693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 19:17:01.363875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.363957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.364115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 19:17:01.364195 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.364389 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.364480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.364648 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.364729 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.364903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.365158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.374480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.374759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.374974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.375058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.375254 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.375377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.375525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.375810 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.382235 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.382649 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.385134 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.385433 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.385561 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.385722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.385818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.386011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.386108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.386305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.386390 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.386573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.386657 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.386849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.386949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.387135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.387218 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.387411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.387492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.387689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.387793 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.388487 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.388752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.389244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.411258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.412737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.412883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.413028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.414227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.414512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.417684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.417975 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.418260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.419757 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.420249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.420640 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.425131 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.425422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.426940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.427230 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.431167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.431390 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.431474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.431682 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.431765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.431967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.432050 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.432252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.432334 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.432527 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.432620 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.432798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.432879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.433064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.433144 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.433329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.449102 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.449384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.453293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.456016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.456305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.456623 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.456924 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.460131 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.461143 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.463351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.463648 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.464303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.467742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.467950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.468034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.468324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.468614 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.468898 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.469202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.471112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.474310 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.474610 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.474930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.475332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.475631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.475912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.487201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.487201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.487201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.487201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.493514 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.493815 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.494043 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.494143 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.494340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.495677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.497210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.498051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.500930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.501226 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.501512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.501805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.501900 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.502207 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.503400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.504922 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.505207 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.507857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.508142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.508532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.508816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.509109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.513427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.513717 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.514001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.514288 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.514674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.514999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.515285 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.520157 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.520449 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.520829 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.521114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.521397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.521682 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.521958 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.531048 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.533971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.536873 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.537742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.538298 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.539922 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.540210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.540610 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.540692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.543473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.545647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.547259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.547541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.547634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.547821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.549070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.551965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.552372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.552664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.552948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.554130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.555637 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.558561 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.558882 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.559170 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.559453 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.561285 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.561586 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.561873 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.567983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.568273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.568554 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.568757 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.569046 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.569332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.569616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.569897 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.570176 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.570453 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.570746 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.571054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.571340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.571631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.571899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.572179 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.572470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.575535 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:17:01.575760 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.576052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.576329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.576602 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.576885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.577168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.577442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.577717 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.577985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.578266 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.578535 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.578808 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.579092 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:17:01.606436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ad90b619c0 pid: 81421 (default app) Sep 24 19:17:01.610259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745aca25-e950-4573-9031-aecab42e0bda None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:01.610550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745aca25-e950-4573-9031-aecab42e0bda None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:01.610842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745aca25-e950-4573-9031-aecab42e0bda None None] PATH_INFO: `/v3` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:01.612505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ad90b619c0 pid: 81420 (default app) Sep 24 19:17:01.615038 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Sat Sep 24 19:17:01 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:08.451671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fd622-85a1-438d-94d2-135a674bc526 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:08.452178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fd622-85a1-438d-94d2-135a674bc526 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:08.452264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fd622-85a1-438d-94d2-135a674bc526 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:08.456466 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:08.461792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94103265-2e9a-4b89-83b8-fec981991f2b None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:08.462268 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94103265-2e9a-4b89-83b8-fec981991f2b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:08.462361 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94103265-2e9a-4b89-83b8-fec981991f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:08.532871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: INFO dbcounter [None req-94103265-2e9a-4b89-83b8-fec981991f2b None None] Registered counter for database keystone Sep 24 19:17:08.552241 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG oslo_db.sqlalchemy.engines [None req-94103265-2e9a-4b89-83b8-fec981991f2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81421) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 19:17:08.558631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writer thread running {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 19:17:08.738789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG passlib.handlers.bcrypt [None req-94103265-2e9a-4b89-83b8-fec981991f2b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81421) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 24 19:17:08.739222 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG passlib.handlers.bcrypt [None req-94103265-2e9a-4b89-83b8-fec981991f2b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81421) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 24 19:17:08.796932 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-94103265-2e9a-4b89-83b8-fec981991f2b None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:08.798547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-94103265-2e9a-4b89-83b8-fec981991f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:08.926072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 24 19:17:09.359811 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fd622-85a1-438d-94d2-135a674bc526 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:09.429883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: INFO dbcounter [None req-6f1fd622-85a1-438d-94d2-135a674bc526 None None] Registered counter for database keystone Sep 24 19:17:09.452892 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG oslo_db.sqlalchemy.engines [None req-6f1fd622-85a1-438d-94d2-135a674bc526 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81420) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 19:17:09.459056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writer thread running {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 19:17:09.578667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fd622-85a1-438d-94d2-135a674bc526 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:09.582974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc4f0e-a0b8-4648-bd2d-604604d0bdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:09.583595 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc4f0e-a0b8-4648-bd2d-604604d0bdd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:09.583871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc4f0e-a0b8-4648-bd2d-604604d0bdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:09.584138 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc4f0e-a0b8-4648-bd2d-604604d0bdd5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:09.592865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc4f0e-a0b8-4648-bd2d-604604d0bdd5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:09.642237 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: WARNING keystone.common.rbac_enforcer.enforcer [None req-36bc4f0e-a0b8-4648-bd2d-604604d0bdd5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 24 19:17:09.642520 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc4f0e-a0b8-4648-bd2d-604604d0bdd5 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:09.651994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Sat Sep 24 19:17:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 19:17:09.658443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94103265-2e9a-4b89-83b8-fec981991f2b None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:09.675124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94103265-2e9a-4b89-83b8-fec981991f2b None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:09.679511 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd34c4-a2e3-401d-9282-2844f6bd87de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:09.680634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd34c4-a2e3-401d-9282-2844f6bd87de admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:09.680918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd34c4-a2e3-401d-9282-2844f6bd87de admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:09.681192 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd34c4-a2e3-401d-9282-2844f6bd87de admin admin] PATH_INFO: `/v3/projects/80330a20cbd94abd8d12b2c485818669` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:09.682773 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd34c4-a2e3-401d-9282-2844f6bd87de admin admin] RBAC: Authorizing `identity:get_project(project_id=80330a20cbd94abd8d12b2c485818669)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:09.735527 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f5fd34c4-a2e3-401d-9282-2844f6bd87de admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 24 19:17:09.735871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd34c4-a2e3-401d-9282-2844f6bd87de admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:09.740370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Sat Sep 24 19:17:09 2022] GET /identity/v3/projects/80330a20cbd94abd8d12b2c485818669 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:11.861859 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8c152-519f-4907-bc45-a0e7e875bbbc None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:11.862424 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8c152-519f-4907-bc45-a0e7e875bbbc None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:11.862424 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8c152-519f-4907-bc45-a0e7e875bbbc None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:11.866526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:17:11.872340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450e2a6-997e-4f9d-91c8-d9339faa6e47 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:11.872777 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450e2a6-997e-4f9d-91c8-d9339faa6e47 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:11.872986 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450e2a6-997e-4f9d-91c8-d9339faa6e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:11.893182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-6450e2a6-997e-4f9d-91c8-d9339faa6e47 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:11.894666 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6450e2a6-997e-4f9d-91c8-d9339faa6e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:11.902548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 24 19:17:12.174323 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8c152-519f-4907-bc45-a0e7e875bbbc None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:12.186564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8c152-519f-4907-bc45-a0e7e875bbbc None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:12.190731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b699b1-1ea1-48b5-99e4-6609557d603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:12.191348 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b699b1-1ea1-48b5-99e4-6609557d603c admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:12.191622 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b699b1-1ea1-48b5-99e4-6609557d603c admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:12.191887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b699b1-1ea1-48b5-99e4-6609557d603c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:12.199357 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b699b1-1ea1-48b5-99e4-6609557d603c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:12.201297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b699b1-1ea1-48b5-99e4-6609557d603c admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:12.209797 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Sat Sep 24 19:17:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 19:17:12.214954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450e2a6-997e-4f9d-91c8-d9339faa6e47 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:12.224494 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450e2a6-997e-4f9d-91c8-d9339faa6e47 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:12.228849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d4e8e-8f05-4eea-8fec-4dd51768a354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:12.229474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d4e8e-8f05-4eea-8fec-4dd51768a354 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:12.229755 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d4e8e-8f05-4eea-8fec-4dd51768a354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:12.230030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d4e8e-8f05-4eea-8fec-4dd51768a354 admin admin] PATH_INFO: `/v3/users/a348fc63930b48c2bf96319b964824d3` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:12.231958 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d4e8e-8f05-4eea-8fec-4dd51768a354 admin admin] RBAC: Authorizing `identity:get_user(user_id=a348fc63930b48c2bf96319b964824d3)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:12.233773 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d4e8e-8f05-4eea-8fec-4dd51768a354 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:12.235329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Sat Sep 24 19:17:12 2022] GET /identity/v3/users/a348fc63930b48c2bf96319b964824d3 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:14.456160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55382d-0429-488b-ac8e-a608e596625b None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:14.456685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55382d-0429-488b-ac8e-a608e596625b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:14.456685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55382d-0429-488b-ac8e-a608e596625b None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:14.458023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:14.463186 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc272ce-d378-42e2-94d2-65f8c022dddc None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:14.463596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc272ce-d378-42e2-94d2-65f8c022dddc None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:14.463739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc272ce-d378-42e2-94d2-65f8c022dddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:14.483684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-0bc272ce-d378-42e2-94d2-65f8c022dddc None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:14.484890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-0bc272ce-d378-42e2-94d2-65f8c022dddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:14.485124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa560992-c98c-4de6-8c75-0be270be6207 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:14.485409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa560992-c98c-4de6-8c75-0be270be6207 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:14.485684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa560992-c98c-4de6-8c75-0be270be6207 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:14.487012 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:14.491997 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1a946-d33c-44fb-8510-36feb07ebcec None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:14.492283 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1a946-d33c-44fb-8510-36feb07ebcec None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:14.492555 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1a946-d33c-44fb-8510-36feb07ebcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:14.535654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG passlib.handlers.bcrypt [None req-7ef1a946-d33c-44fb-8510-36feb07ebcec None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81420) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 24 19:17:14.536114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG passlib.handlers.bcrypt [None req-7ef1a946-d33c-44fb-8510-36feb07ebcec None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81420) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 24 19:17:14.567521 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:14.584932 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-7ef1a946-d33c-44fb-8510-36feb07ebcec None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:14.586530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7ef1a946-d33c-44fb-8510-36feb07ebcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:14.685436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:17:14.833143 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc272ce-d378-42e2-94d2-65f8c022dddc None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:14.858222 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:14.937770 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc272ce-d378-42e2-94d2-65f8c022dddc None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:14.954052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1a946-d33c-44fb-8510-36feb07ebcec None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:14.971956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3112ba5-90dc-4e1b-aec3-f0eb01f983fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:14.972599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3112ba5-90dc-4e1b-aec3-f0eb01f983fa None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:14.972877 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3112ba5-90dc-4e1b-aec3-f0eb01f983fa None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:14.973150 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3112ba5-90dc-4e1b-aec3-f0eb01f983fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:14.984384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3112ba5-90dc-4e1b-aec3-f0eb01f983fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:14.993163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-e3112ba5-90dc-4e1b-aec3-f0eb01f983fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:17:14.993163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:14.993163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:14.993163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:14.993163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:14.993163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:14.993163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:14.993163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:14.993163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:14.993163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:14.993163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:14.993163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:14.993163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:14.993163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:14.993163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:14.993163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:14.994248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:14.994248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:14.994248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:14.994248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:14.994248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:14.994248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:14.994248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:14.994248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:14.994248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:14.994248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:14.994248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:14.994248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:14.994248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:14.994248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:14.994248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:14.994248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:14.995581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:14.995581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:14.995581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:14.995581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:14.995581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:14.995581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:14.995581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:14.995581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:14.995581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:14.995581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:14.995581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:17:14.995581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:17:14.995581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:17:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:15.000401 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3112ba5-90dc-4e1b-aec3-f0eb01f983fa None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:15.054708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1a946-d33c-44fb-8510-36feb07ebcec None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:15.057021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:15.082491 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:15.095465 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb53847-69bc-483e-9255-0c9e2ec37ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:15.096324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb53847-69bc-483e-9255-0c9e2ec37ecb None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:15.096607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb53847-69bc-483e-9255-0c9e2ec37ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:15.096873 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb53847-69bc-483e-9255-0c9e2ec37ecb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:15.102046 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3112ba5-90dc-4e1b-aec3-f0eb01f983fa None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:15.136316 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffba4f-4ac8-47d5-b9a9-f951d8c6681d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:15.136924 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffba4f-4ac8-47d5-b9a9-f951d8c6681d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:15.137201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffba4f-4ac8-47d5-b9a9-f951d8c6681d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:15.137538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffba4f-4ac8-47d5-b9a9-f951d8c6681d None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:15.138299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffba4f-4ac8-47d5-b9a9-f951d8c6681d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:15.138597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffba4f-4ac8-47d5-b9a9-f951d8c6681d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:15.140010 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffba4f-4ac8-47d5-b9a9-f951d8c6681d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:15.151753 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 8/15] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:17:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:17:15.157949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffba4f-4ac8-47d5-b9a9-f951d8c6681d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:15.166752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb53847-69bc-483e-9255-0c9e2ec37ecb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:15.168298 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb53847-69bc-483e-9255-0c9e2ec37ecb None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:15.255546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffba4f-4ac8-47d5-b9a9-f951d8c6681d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:15.267105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:17:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 19:17:15.272964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb53847-69bc-483e-9255-0c9e2ec37ecb None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:15.275968 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:15.289800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d870254-082a-444e-b389-5d1400c63447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:15.290467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d870254-082a-444e-b389-5d1400c63447 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:15.290749 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d870254-082a-444e-b389-5d1400c63447 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:15.291048 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d870254-082a-444e-b389-5d1400c63447 None admin] PATH_INFO: `/v3/users/a348fc63930b48c2bf96319b964824d3` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:15.292213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d870254-082a-444e-b389-5d1400c63447 None admin] RBAC: Authorizing `identity:get_user(user_id=a348fc63930b48c2bf96319b964824d3)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:15.293708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d870254-082a-444e-b389-5d1400c63447 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:15.295970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:15 2022] GET /identity/v3/users/a348fc63930b48c2bf96319b964824d3 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:17:15.301110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d870254-082a-444e-b389-5d1400c63447 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:15.315502 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:15.371362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb53847-69bc-483e-9255-0c9e2ec37ecb None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:15.401810 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d870254-082a-444e-b389-5d1400c63447 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:15.411319 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49db8f-5f2c-41de-984f-f28a91367831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:15.412179 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49db8f-5f2c-41de-984f-f28a91367831 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:15.412451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49db8f-5f2c-41de-984f-f28a91367831 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:15.412722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49db8f-5f2c-41de-984f-f28a91367831 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:15.431904 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49db8f-5f2c-41de-984f-f28a91367831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:15.433373 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49db8f-5f2c-41de-984f-f28a91367831 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:15.440758 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0dd547-58ee-4ad1-9dcb-a37bc05212ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:15.441386 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dd547-58ee-4ad1-9dcb-a37bc05212ca None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:15.441663 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dd547-58ee-4ad1-9dcb-a37bc05212ca None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:15.441932 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dd547-58ee-4ad1-9dcb-a37bc05212ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:15.443059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0dd547-58ee-4ad1-9dcb-a37bc05212ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:15.444460 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0dd547-58ee-4ad1-9dcb-a37bc05212ca None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:15.445983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 10/18] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:17:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:17:15.451440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-ef49db8f-5f2c-41de-984f-f28a91367831 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:17:15.451440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:15.451440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:15.451440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:15.451440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:15.451440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:15.451440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:15.451440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:15.451440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:15.451440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:15.451440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:15.451440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:15.451440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:17:15.451440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:17:15.451440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:17:15.451440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:17:15.452454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:15.452454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:15.452454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:15.452454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:15.452454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:15.452454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:15.452454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:15.452454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:15.452454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:15.452454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:15.452454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:15.452454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:15.452454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:15.452454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:15.452454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:15.452454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:15.452454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:17:15.453466 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:17:15.453466 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:17:15.453466 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:17:15.453678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0dd547-58ee-4ad1-9dcb-a37bc05212ca None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:15.454970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 9/19] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:17:15.458103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49db8f-5f2c-41de-984f-f28a91367831 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:15.514077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:15.532688 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:15.552481 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0dd547-58ee-4ad1-9dcb-a37bc05212ca None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:15.557536 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49db8f-5f2c-41de-984f-f28a91367831 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:15.586854 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24f2c0-81f7-4135-9002-300531967d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:15.587469 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24f2c0-81f7-4135-9002-300531967d59 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:15.587753 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24f2c0-81f7-4135-9002-300531967d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:15.588048 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24f2c0-81f7-4135-9002-300531967d59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:15.588761 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24f2c0-81f7-4135-9002-300531967d59 None admin] RBAC: Adding query filter params (role.id=dd27845a836a4f6ebece149dbebc59c0, scope.domain.id=default, user.id=a348fc63930b48c2bf96319b964824d3) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:15.589062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24f2c0-81f7-4135-9002-300531967d59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:15.590489 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24f2c0-81f7-4135-9002-300531967d59 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:15.591536 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd73302-78af-408d-8f92-c1a1104e0942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:15.592136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd73302-78af-408d-8f92-c1a1104e0942 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:15.592408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd73302-78af-408d-8f92-c1a1104e0942 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:15.592673 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd73302-78af-408d-8f92-c1a1104e0942 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:15.593305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd73302-78af-408d-8f92-c1a1104e0942 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:15.593598 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd73302-78af-408d-8f92-c1a1104e0942 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:15.595016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd73302-78af-408d-8f92-c1a1104e0942 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:15.598157 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 11/20] 10.222.0.25 () {56 vars in 1322 bytes} [Sat Sep 24 19:17:15 2022] GET /identity/v3/role_assignments?user.id=a348fc63930b48c2bf96319b964824d3&scope.domain.id=default&role.id=dd27845a836a4f6ebece149dbebc59c0 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:17:15.614086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 10/21] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:17:17.883376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d9dac-9f1e-4a2d-a8c4-56d25465c932 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:17.884404 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d9dac-9f1e-4a2d-a8c4-56d25465c932 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:17.884816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d9dac-9f1e-4a2d-a8c4-56d25465c932 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:17.886283 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 12/22] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:17.892343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da142f55-6fb8-4633-a943-9b249671af5d None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:17.892776 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da142f55-6fb8-4633-a943-9b249671af5d None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:17.892869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da142f55-6fb8-4633-a943-9b249671af5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:17.920805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-da142f55-6fb8-4633-a943-9b249671af5d None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:17.922025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-da142f55-6fb8-4633-a943-9b249671af5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:18.017346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 11/23] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:18.121699 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31c9e1-826b-4023-8318-56bc4400a9e8 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:18.122673 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31c9e1-826b-4023-8318-56bc4400a9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:18.123265 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31c9e1-826b-4023-8318-56bc4400a9e8 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:18.124844 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:18.129970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4fa27-123b-4256-9440-0c8a15a3c44e None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:18.130258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4fa27-123b-4256-9440-0c8a15a3c44e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:18.130535 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4fa27-123b-4256-9440-0c8a15a3c44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:18.160017 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-79f4fa27-123b-4256-9440-0c8a15a3c44e None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:18.161148 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-79f4fa27-123b-4256-9440-0c8a15a3c44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:18.220187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:18.257570 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 12/25] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:18.434743 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31c9e1-826b-4023-8318-56bc4400a9e8 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:18.568177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31c9e1-826b-4023-8318-56bc4400a9e8 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:18.615148 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d840dc-87cf-4cad-8341-9b959b36c49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:18.615785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d840dc-87cf-4cad-8341-9b959b36c49e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:18.616064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d840dc-87cf-4cad-8341-9b959b36c49e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:18.616337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d840dc-87cf-4cad-8341-9b959b36c49e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:18.632188 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d840dc-87cf-4cad-8341-9b959b36c49e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:18.638486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-c4d840dc-87cf-4cad-8341-9b959b36c49e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:17:18.638486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:18.638486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:18.638486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:18.638486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:18.638486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:18.638486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:18.638486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:18.638486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:18.638486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:18.638486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:18.638486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:18.638486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:18.638486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:18.638486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:18.638486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:18.639359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:18.639359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:18.639359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:18.639359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:18.639359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:18.639359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:18.639359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:18.639359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:18.639359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:18.639359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:18.639359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:18.639359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:18.639359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:18.639359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:18.639359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:18.639359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:18.640140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:18.640140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:18.640140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:18.640140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:18.640140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:18.640140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:18.640140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:18.640140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:18.640140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:18.640140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:18.640140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:17:18.640140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:17:18.640140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 14/26] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:17:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:18.647089 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4fa27-123b-4256-9440-0c8a15a3c44e None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:18.795756 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4fa27-123b-4256-9440-0c8a15a3c44e None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:18.834232 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33052a9-8ca9-4b1a-83be-488fa895a554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:18.834919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33052a9-8ca9-4b1a-83be-488fa895a554 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:18.835155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33052a9-8ca9-4b1a-83be-488fa895a554 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:18.835430 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33052a9-8ca9-4b1a-83be-488fa895a554 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:18.836091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33052a9-8ca9-4b1a-83be-488fa895a554 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:18.836402 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33052a9-8ca9-4b1a-83be-488fa895a554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:18.837764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33052a9-8ca9-4b1a-83be-488fa895a554 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:18.849868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 13/27] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:17:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:18.855715 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d840dc-87cf-4cad-8341-9b959b36c49e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:18.867145 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:18.890568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33052a9-8ca9-4b1a-83be-488fa895a554 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:18.971214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:19.031315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d840dc-87cf-4cad-8341-9b959b36c49e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:19.062600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33052a9-8ca9-4b1a-83be-488fa895a554 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:19.079853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c3fee-854a-4b4d-9d36-5d54156584f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:19.080788 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c3fee-854a-4b4d-9d36-5d54156584f1 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:19.081227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c3fee-854a-4b4d-9d36-5d54156584f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:19.081661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c3fee-854a-4b4d-9d36-5d54156584f1 None admin] PATH_INFO: `/v3/users/a348fc63930b48c2bf96319b964824d3` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:19.083019 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c3fee-854a-4b4d-9d36-5d54156584f1 None admin] RBAC: Authorizing `identity:get_user(user_id=a348fc63930b48c2bf96319b964824d3)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:19.084658 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c3fee-854a-4b4d-9d36-5d54156584f1 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:19.086708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 15/28] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:18 2022] GET /identity/v3/users/a348fc63930b48c2bf96319b964824d3 => generated 247 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:19.088100 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fc67b-556b-4f19-ab6b-c3a429ab5a3f None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:19.088543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fc67b-556b-4f19-ab6b-c3a429ab5a3f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:19.089059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fc67b-556b-4f19-ab6b-c3a429ab5a3f None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:19.091554 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 16/29] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:19.092995 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d144a-155b-49fb-af90-be74bd1e9697 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:19.093468 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d144a-155b-49fb-af90-be74bd1e9697 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:19.093879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d144a-155b-49fb-af90-be74bd1e9697 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:19.099443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 17/30] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:19.099847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d144a-155b-49fb-af90-be74bd1e9697 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:19.101051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4092289-61d1-4ec4-8a22-10ab25e9adee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:19.101688 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4092289-61d1-4ec4-8a22-10ab25e9adee None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:19.101962 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4092289-61d1-4ec4-8a22-10ab25e9adee None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:19.102231 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4092289-61d1-4ec4-8a22-10ab25e9adee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:19.115731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4092289-61d1-4ec4-8a22-10ab25e9adee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:19.117197 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4092289-61d1-4ec4-8a22-10ab25e9adee None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:19.132826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-e4092289-61d1-4ec4-8a22-10ab25e9adee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:17:19.132826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:19.132826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:19.132826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:19.132826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:19.132826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:19.132826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:19.132826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:19.132826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:19.132826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:19.132826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:19.132826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:19.132826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:17:19.132826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:17:19.132826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:17:19.132826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:17:19.133708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:19.133708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:19.133708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:19.133708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:19.133708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:19.133708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:19.133708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:19.133708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:19.133708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:19.133708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:19.133708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:19.133708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:19.133708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:19.133708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:19.133708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:19.133708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:19.133708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:17:19.134520 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:17:19.134520 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:17:19.134520 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:17:19.134520 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 14/31] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:17:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:17:19.135526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61a5be-a79d-4c6e-95a4-6056c601cb1f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:19.135526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61a5be-a79d-4c6e-95a4-6056c601cb1f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:19.135692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61a5be-a79d-4c6e-95a4-6056c601cb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:19.156826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-6c61a5be-a79d-4c6e-95a4-6056c601cb1f None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:19.158017 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6c61a5be-a79d-4c6e-95a4-6056c601cb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:19.185170 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:19.229989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d144a-155b-49fb-af90-be74bd1e9697 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:19.236769 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 15/32] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:19.238298 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77e42a-ebf7-4151-9016-e3409fc9d4c5 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:19.238789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77e42a-ebf7-4151-9016-e3409fc9d4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:19.239416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77e42a-ebf7-4151-9016-e3409fc9d4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:19.276766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-2b77e42a-ebf7-4151-9016-e3409fc9d4c5 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:19.280814 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2b77e42a-ebf7-4151-9016-e3409fc9d4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:19.302416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11f1cd-899e-4935-90a1-8631436d2513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:19.303847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11f1cd-899e-4935-90a1-8631436d2513 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:19.304853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11f1cd-899e-4935-90a1-8631436d2513 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:19.305656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11f1cd-899e-4935-90a1-8631436d2513 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:19.308261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11f1cd-899e-4935-90a1-8631436d2513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:19.312993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:19.313931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11f1cd-899e-4935-90a1-8631436d2513 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:19.318428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 18/33] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:17:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:19.320835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11f1cd-899e-4935-90a1-8631436d2513 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:19.447096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 16/34] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:19.448365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77e42a-ebf7-4151-9016-e3409fc9d4c5 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:19.474467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11f1cd-899e-4935-90a1-8631436d2513 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:19.550187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887be7c-933d-41c9-a25a-cc9821a1a5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:19.552265 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887be7c-933d-41c9-a25a-cc9821a1a5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:19.552789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887be7c-933d-41c9-a25a-cc9821a1a5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:19.553482 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887be7c-933d-41c9-a25a-cc9821a1a5a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:19.554924 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887be7c-933d-41c9-a25a-cc9821a1a5a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:19.555634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887be7c-933d-41c9-a25a-cc9821a1a5a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:19.560334 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887be7c-933d-41c9-a25a-cc9821a1a5a0 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:19.594265 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:19.603107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 19/35] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:19.610407 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887be7c-933d-41c9-a25a-cc9821a1a5a0 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:19.640607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77e42a-ebf7-4151-9016-e3409fc9d4c5 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:19.714625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39e932-c528-4f53-9a4f-082c65ceb8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:19.715769 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39e932-c528-4f53-9a4f-082c65ceb8bf None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:19.716323 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39e932-c528-4f53-9a4f-082c65ceb8bf None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:19.716802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39e932-c528-4f53-9a4f-082c65ceb8bf None admin] PATH_INFO: `/v3/domains/default/users/a348fc63930b48c2bf96319b964824d3/roles/dd27845a836a4f6ebece149dbebc59c0` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:19.719349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39e932-c528-4f53-9a4f-082c65ceb8bf None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a348fc63930b48c2bf96319b964824d3, role_id=dd27845a836a4f6ebece149dbebc59c0)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:19.721308 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39e932-c528-4f53-9a4f-082c65ceb8bf None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:19.779107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887be7c-933d-41c9-a25a-cc9821a1a5a0 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:19.818456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c182049-dabd-4ef2-90a4-0ffbba21b78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:19.819121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c182049-dabd-4ef2-90a4-0ffbba21b78a None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:19.819448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c182049-dabd-4ef2-90a4-0ffbba21b78a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:19.819717 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c182049-dabd-4ef2-90a4-0ffbba21b78a None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:19.820393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c182049-dabd-4ef2-90a4-0ffbba21b78a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:19.821936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c182049-dabd-4ef2-90a4-0ffbba21b78a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:19.858684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 17/36] 10.222.0.25 () {58 vars in 1361 bytes} [Sat Sep 24 19:17:19 2022] PUT /identity/v3/domains/default/users/a348fc63930b48c2bf96319b964824d3/roles/dd27845a836a4f6ebece149dbebc59c0 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:17:19.860798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93734f68-929c-4a94-b4c2-119887e789a5 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:19.861292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93734f68-929c-4a94-b4c2-119887e789a5 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:19.861799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93734f68-929c-4a94-b4c2-119887e789a5 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:19.866614 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 18/37] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:19.867692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93734f68-929c-4a94-b4c2-119887e789a5 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:19.889059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:19.995520 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93734f68-929c-4a94-b4c2-119887e789a5 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:19.997898 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 20/38] 10.222.0.25 () {60 vars in 1141 bytes} [Sat Sep 24 19:17:19 2022] POST /identity/v3/projects => generated 301 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:17:19.999418 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d17fc5-8564-4cc8-a724-445a7e16a3fd None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:19.999716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d17fc5-8564-4cc8-a724-445a7e16a3fd None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:19.999999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d17fc5-8564-4cc8-a724-445a7e16a3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:20.021317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-e2d17fc5-8564-4cc8-a724-445a7e16a3fd None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:20.031150 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e2d17fc5-8564-4cc8-a724-445a7e16a3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:20.047110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87fc88-7f9e-48de-917b-28c133ec5345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:20.048234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87fc88-7f9e-48de-917b-28c133ec5345 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:20.048870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87fc88-7f9e-48de-917b-28c133ec5345 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:20.049435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87fc88-7f9e-48de-917b-28c133ec5345 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:20.050407 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87fc88-7f9e-48de-917b-28c133ec5345 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:20.053300 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87fc88-7f9e-48de-917b-28c133ec5345 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:20.075297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1131 bytes} [Sat Sep 24 19:17:19 2022] POST /identity/v3/roles => generated 219 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:17:20.075928 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87fc88-7f9e-48de-917b-28c133ec5345 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:20.133215 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:20.184092 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 21/40] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:20.188976 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e68783-7f14-407d-9daf-616066a6e069 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:20.189260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e68783-7f14-407d-9daf-616066a6e069 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:20.189538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e68783-7f14-407d-9daf-616066a6e069 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:20.193931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 22/41] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:20.199183 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb21b6-d986-4887-8e06-66e7573297df None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:20.199494 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb21b6-d986-4887-8e06-66e7573297df None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:20.201283 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb21b6-d986-4887-8e06-66e7573297df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:20.230271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:20.236951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-26cb21b6-d986-4887-8e06-66e7573297df None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:20.238156 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-26cb21b6-d986-4887-8e06-66e7573297df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:20.292093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87fc88-7f9e-48de-917b-28c133ec5345 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:20.363156 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5408e-1d0b-4a91-a726-06dfaabdd975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:20.363790 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5408e-1d0b-4a91-a726-06dfaabdd975 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:20.364068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5408e-1d0b-4a91-a726-06dfaabdd975 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:20.364339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5408e-1d0b-4a91-a726-06dfaabdd975 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:20.365012 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5408e-1d0b-4a91-a726-06dfaabdd975 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:20.366412 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5408e-1d0b-4a91-a726-06dfaabdd975 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:20.374590 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 23/42] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:20.391716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 20/43] 10.222.0.25 () {60 vars in 1131 bytes} [Sat Sep 24 19:17:20 2022] POST /identity/v3/roles => generated 225 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:17:20.534674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb21b6-d986-4887-8e06-66e7573297df None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:20.645289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb21b6-d986-4887-8e06-66e7573297df None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:20.690744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5408e-1d0b-4a91-a726-06dfaabdd975 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:20.766150 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:20.789883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb942f-7d32-4231-91b6-36af342f8d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:20.790503 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb942f-7d32-4231-91b6-36af342f8d4c None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:20.790788 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb942f-7d32-4231-91b6-36af342f8d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:20.791089 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb942f-7d32-4231-91b6-36af342f8d4c None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:20.791757 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb942f-7d32-4231-91b6-36af342f8d4c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:20.793266 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb942f-7d32-4231-91b6-36af342f8d4c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:20.806006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5408e-1d0b-4a91-a726-06dfaabdd975 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:20.812258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 24/44] 10.222.0.25 () {60 vars in 1131 bytes} [Sat Sep 24 19:17:20 2022] POST /identity/v3/roles => generated 223 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:17:20.839973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:20.847191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7aae08-254f-4ec1-92c9-a1a7454cff49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:20.848405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7aae08-254f-4ec1-92c9-a1a7454cff49 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:20.849105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7aae08-254f-4ec1-92c9-a1a7454cff49 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:20.849442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7aae08-254f-4ec1-92c9-a1a7454cff49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:20.850773 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7aae08-254f-4ec1-92c9-a1a7454cff49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:20.852300 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7aae08-254f-4ec1-92c9-a1a7454cff49 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:20.854005 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 21/45] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:17:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:17:20.861224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb942f-7d32-4231-91b6-36af342f8d4c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:20.976026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb942f-7d32-4231-91b6-36af342f8d4c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:21.013544 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79171cf0-c8bf-41af-8e62-a101bc5fe067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:21.014163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79171cf0-c8bf-41af-8e62-a101bc5fe067 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:21.014448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79171cf0-c8bf-41af-8e62-a101bc5fe067 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:21.014723 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79171cf0-c8bf-41af-8e62-a101bc5fe067 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:21.015445 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79171cf0-c8bf-41af-8e62-a101bc5fe067 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:21.016883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79171cf0-c8bf-41af-8e62-a101bc5fe067 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:21.047046 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 25/46] 10.222.0.25 () {60 vars in 1141 bytes} [Sat Sep 24 19:17:20 2022] POST /identity/v3/projects => generated 312 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:17:22.179663 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e241b35-9377-4d88-8dec-e1858541184d None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:22.180212 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e241b35-9377-4d88-8dec-e1858541184d None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:22.180212 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e241b35-9377-4d88-8dec-e1858541184d None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:22.181526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 22/47] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:22.187228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a007c0c-b92b-4fc1-be71-dc2ddb9cf0c7 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:22.187633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a007c0c-b92b-4fc1-be71-dc2ddb9cf0c7 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:22.187867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a007c0c-b92b-4fc1-be71-dc2ddb9cf0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:22.205911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-8a007c0c-b92b-4fc1-be71-dc2ddb9cf0c7 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:22.207125 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8a007c0c-b92b-4fc1-be71-dc2ddb9cf0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:22.224576 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:22.275179 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 26/48] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:22.542238 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e241b35-9377-4d88-8dec-e1858541184d None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:22.641925 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e241b35-9377-4d88-8dec-e1858541184d None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:22.674874 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633c40f-7b57-48f5-9213-59300d2df424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:22.675506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633c40f-7b57-48f5-9213-59300d2df424 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:22.675785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633c40f-7b57-48f5-9213-59300d2df424 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:22.676058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633c40f-7b57-48f5-9213-59300d2df424 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:22.687855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633c40f-7b57-48f5-9213-59300d2df424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:22.694104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-1633c40f-7b57-48f5-9213-59300d2df424 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:17:22.694104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:22.694104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:22.694104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:22.694104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:22.694104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:22.694104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:22.694104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:22.694104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:22.694104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:22.694104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:22.694104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:22.694104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:22.694104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:22.694104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:22.694104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:22.695106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:22.695106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:22.695106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:22.695106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:22.695106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:22.695106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:22.695106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:22.695106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:22.695106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:22.695106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:22.695106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:22.695106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:22.695106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:22.695106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:22.695106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:22.695106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:22.695848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:22.695848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:22.695848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:22.695848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:22.695848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:22.695848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:22.695848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:22.695848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:22.695848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:22.695848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:22.695848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:17:22.695848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:17:22.695848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 23/49] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:17:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:22.701812 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a007c0c-b92b-4fc1-be71-dc2ddb9cf0c7 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:22.801380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a007c0c-b92b-4fc1-be71-dc2ddb9cf0c7 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:22.835834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737e966-4d04-428d-96e0-fbdf3612ce8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:22.836450 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737e966-4d04-428d-96e0-fbdf3612ce8a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:22.836734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737e966-4d04-428d-96e0-fbdf3612ce8a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:22.837012 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737e966-4d04-428d-96e0-fbdf3612ce8a None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:22.837683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737e966-4d04-428d-96e0-fbdf3612ce8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:22.837989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737e966-4d04-428d-96e0-fbdf3612ce8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:22.839407 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737e966-4d04-428d-96e0-fbdf3612ce8a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:22.847716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 27/50] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:17:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:22.853414 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633c40f-7b57-48f5-9213-59300d2df424 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:22.914039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:22.957759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633c40f-7b57-48f5-9213-59300d2df424 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:22.991131 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd69e08-d09c-48bc-8bb5-df14bc7da5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:22.991760 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd69e08-d09c-48bc-8bb5-df14bc7da5a6 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:22.992033 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd69e08-d09c-48bc-8bb5-df14bc7da5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:22.992302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd69e08-d09c-48bc-8bb5-df14bc7da5a6 None admin] PATH_INFO: `/v3/users/a348fc63930b48c2bf96319b964824d3` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:22.993408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd69e08-d09c-48bc-8bb5-df14bc7da5a6 None admin] RBAC: Authorizing `identity:get_user(user_id=a348fc63930b48c2bf96319b964824d3)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:22.994887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd69e08-d09c-48bc-8bb5-df14bc7da5a6 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:22.996447 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 24/51] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:22 2022] GET /identity/v3/users/a348fc63930b48c2bf96319b964824d3 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:23.002801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737e966-4d04-428d-96e0-fbdf3612ce8a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:23.020837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:23.105026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737e966-4d04-428d-96e0-fbdf3612ce8a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:23.141621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd646a-326b-4a5a-a9d6-14f12cf4e212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:23.142287 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd646a-326b-4a5a-a9d6-14f12cf4e212 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:23.142570 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd646a-326b-4a5a-a9d6-14f12cf4e212 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:23.142866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd646a-326b-4a5a-a9d6-14f12cf4e212 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:23.143998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd646a-326b-4a5a-a9d6-14f12cf4e212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:23.145450 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd646a-326b-4a5a-a9d6-14f12cf4e212 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:23.147045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 28/52] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:17:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:23.153220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd69e08-d09c-48bc-8bb5-df14bc7da5a6 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:23.217873 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0807028-d415-4c9b-99a6-fcc959d792dd None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:23.218404 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0807028-d415-4c9b-99a6-fcc959d792dd None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:23.218404 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0807028-d415-4c9b-99a6-fcc959d792dd None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:23.219797 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 29/53] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:17:23.224827 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a9c95-80a3-452a-b885-b512cd66c84f None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:23.225120 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a9c95-80a3-452a-b885-b512cd66c84f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:23.225400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a9c95-80a3-452a-b885-b512cd66c84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:23.243716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-ee8a9c95-80a3-452a-b885-b512cd66c84f None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:23.244906 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ee8a9c95-80a3-452a-b885-b512cd66c84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:23.253814 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd69e08-d09c-48bc-8bb5-df14bc7da5a6 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:23.279796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:23.289398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95736a-63cd-41c5-bef6-133b650e275a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:23.290001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95736a-63cd-41c5-bef6-133b650e275a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:23.290278 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95736a-63cd-41c5-bef6-133b650e275a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:23.290608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95736a-63cd-41c5-bef6-133b650e275a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:23.291355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95736a-63cd-41c5-bef6-133b650e275a None admin] RBAC: Adding query filter params (role.id=dd27845a836a4f6ebece149dbebc59c0, scope.domain.id=default, user.id=a348fc63930b48c2bf96319b964824d3) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:23.291717 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95736a-63cd-41c5-bef6-133b650e275a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:23.293146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95736a-63cd-41c5-bef6-133b650e275a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:23.301754 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 25/54] 10.222.0.25 () {56 vars in 1322 bytes} [Sat Sep 24 19:17:23 2022] GET /identity/v3/role_assignments?user.id=a348fc63930b48c2bf96319b964824d3&scope.domain.id=default&role.id=dd27845a836a4f6ebece149dbebc59c0 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:23.313199 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 30/55] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:17:23.582585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95736a-63cd-41c5-bef6-133b650e275a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:23.678529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95736a-63cd-41c5-bef6-133b650e275a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:23.711153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d97017-2419-4186-9a3b-fadde733538a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:23.711769 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d97017-2419-4186-9a3b-fadde733538a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:23.712050 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d97017-2419-4186-9a3b-fadde733538a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:23.712323 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d97017-2419-4186-9a3b-fadde733538a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:23.713454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d97017-2419-4186-9a3b-fadde733538a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:23.714922 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d97017-2419-4186-9a3b-fadde733538a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:23.716499 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 26/56] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:17:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:23.722072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a9c95-80a3-452a-b885-b512cd66c84f None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:23.737186 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:23.820425 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a9c95-80a3-452a-b885-b512cd66c84f None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:23.852727 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b488c-cd30-4a2c-95be-e429aed92b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:23.853329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b488c-cd30-4a2c-95be-e429aed92b57 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:23.853610 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b488c-cd30-4a2c-95be-e429aed92b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:23.853884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b488c-cd30-4a2c-95be-e429aed92b57 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:23.854537 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b488c-cd30-4a2c-95be-e429aed92b57 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:23.856524 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b488c-cd30-4a2c-95be-e429aed92b57 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:23.881812 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 31/57] 10.222.0.25 () {60 vars in 1140 bytes} [Sat Sep 24 19:17:23 2022] POST /identity/v3/projects => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:17:26.029616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0fffa-9862-4351-b82a-31f968902fcd None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:26.030138 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0fffa-9862-4351-b82a-31f968902fcd None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:26.030138 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0fffa-9862-4351-b82a-31f968902fcd None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:26.031536 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 27/58] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:26.036717 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c86f1b-16ff-49ae-a45b-9cb809bc01a2 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:26.037137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c86f1b-16ff-49ae-a45b-9cb809bc01a2 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:26.037264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c86f1b-16ff-49ae-a45b-9cb809bc01a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:26.056980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-98c86f1b-16ff-49ae-a45b-9cb809bc01a2 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:26.058170 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-98c86f1b-16ff-49ae-a45b-9cb809bc01a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:26.118370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:26.127347 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 32/59] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:26.401457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0fffa-9862-4351-b82a-31f968902fcd None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:26.470562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:26.511293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0fffa-9862-4351-b82a-31f968902fcd None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:26.544497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daaebb5-e4be-46e1-b9c6-98ee19c76977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:26.545113 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daaebb5-e4be-46e1-b9c6-98ee19c76977 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:26.545390 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daaebb5-e4be-46e1-b9c6-98ee19c76977 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:26.545658 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daaebb5-e4be-46e1-b9c6-98ee19c76977 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:26.546754 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daaebb5-e4be-46e1-b9c6-98ee19c76977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:26.548222 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daaebb5-e4be-46e1-b9c6-98ee19c76977 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:26.549759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 28/60] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:17:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:26.555312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c86f1b-16ff-49ae-a45b-9cb809bc01a2 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:26.651861 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c86f1b-16ff-49ae-a45b-9cb809bc01a2 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:26.685665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09267002-89ea-42c1-a51a-872d4b3c2376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:26.686269 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09267002-89ea-42c1-a51a-872d4b3c2376 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:26.686553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09267002-89ea-42c1-a51a-872d4b3c2376 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:26.686851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09267002-89ea-42c1-a51a-872d4b3c2376 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:26.687508 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09267002-89ea-42c1-a51a-872d4b3c2376 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:26.688938 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09267002-89ea-42c1-a51a-872d4b3c2376 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:26.714415 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 33/61] 10.222.0.25 () {60 vars in 1132 bytes} [Sat Sep 24 19:17:26 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:17:29.977541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b610ed-f941-40a0-9221-282bdc02360b None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:29.978061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b610ed-f941-40a0-9221-282bdc02360b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:29.978061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b610ed-f941-40a0-9221-282bdc02360b None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:29.979744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 29/62] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:29.985448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99582890-1d72-48d7-b05f-a1fa0d300b2d None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:29.986252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99582890-1d72-48d7-b05f-a1fa0d300b2d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:29.986727 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99582890-1d72-48d7-b05f-a1fa0d300b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:30.011832 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-99582890-1d72-48d7-b05f-a1fa0d300b2d None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:30.013979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-99582890-1d72-48d7-b05f-a1fa0d300b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:30.073907 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:30.097794 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 34/63] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:30.246895 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc4797-e215-4a7b-944c-23bf29507bb0 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:30.247522 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc4797-e215-4a7b-944c-23bf29507bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:30.248026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc4797-e215-4a7b-944c-23bf29507bb0 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:30.249573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 30/64] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:30.254979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110439eb-d02d-44d8-a8ac-4f17b289d5a2 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:30.255498 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110439eb-d02d-44d8-a8ac-4f17b289d5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:30.255967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110439eb-d02d-44d8-a8ac-4f17b289d5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:30.263149 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610a7e7-06b8-4f64-a078-d545df4e32ae None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:30.263690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610a7e7-06b8-4f64-a078-d545df4e32ae None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:30.264232 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610a7e7-06b8-4f64-a078-d545df4e32ae None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:30.265726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 31/65] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:17:30.275578 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4ea3c-3772-47b3-b5b2-b38fe40a8507 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:30.276110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4ea3c-3772-47b3-b5b2-b38fe40a8507 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:30.276617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4ea3c-3772-47b3-b5b2-b38fe40a8507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:30.280789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-110439eb-d02d-44d8-a8ac-4f17b289d5a2 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:30.281988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-110439eb-d02d-44d8-a8ac-4f17b289d5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:30.314411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-86e4ea3c-3772-47b3-b5b2-b38fe40a8507 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:30.316034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-86e4ea3c-3772-47b3-b5b2-b38fe40a8507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:30.389231 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 35/66] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:30.444615 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 32/67] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:17:30.471942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110439eb-d02d-44d8-a8ac-4f17b289d5a2 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:30.575735 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f26887-8a3e-409d-a80b-b4d303d9199a None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:30.575987 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f26887-8a3e-409d-a80b-b4d303d9199a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:30.576212 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f26887-8a3e-409d-a80b-b4d303d9199a None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:30.577807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 33/68] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:30.584153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaf4f7-3ff6-4724-a2d3-97c1611a5795 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:30.584681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaf4f7-3ff6-4724-a2d3-97c1611a5795 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:30.585350 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaf4f7-3ff6-4724-a2d3-97c1611a5795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:30.614599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110439eb-d02d-44d8-a8ac-4f17b289d5a2 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:30.623865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-efaaf4f7-3ff6-4724-a2d3-97c1611a5795 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:30.625079 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-efaaf4f7-3ff6-4724-a2d3-97c1611a5795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:30.639377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:30.679379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef750147-58ee-471d-aaa2-d309bb739f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:30.680024 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef750147-58ee-471d-aaa2-d309bb739f7f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:30.680306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef750147-58ee-471d-aaa2-d309bb739f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:30.680580 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef750147-58ee-471d-aaa2-d309bb739f7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:30.704647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef750147-58ee-471d-aaa2-d309bb739f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:30.709583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-ef750147-58ee-471d-aaa2-d309bb739f7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:17:30.709583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:30.709583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:30.709583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:30.709583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:30.709583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:30.709583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:30.709583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:30.709583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:30.709583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:30.709583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:30.709583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:30.709583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:30.709583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:30.709583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:30.709583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:30.710428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:30.710428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:30.710428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:30.710428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:30.710428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:30.710428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:30.710428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:30.710428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:30.710428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:30.710428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:30.710428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:30.710428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:30.710428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:30.710428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:30.710428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:30.710428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:30.711250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:30.711250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:30.711250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:30.711250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:30.711250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:30.711250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:30.711250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:30.711250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:30.711250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:30.711250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:30.711250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:17:30.711250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:17:30.711250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 36/69] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:17:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:30.720653 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef750147-58ee-471d-aaa2-d309bb739f7f None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:30.726194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:30.744224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 34/70] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:30.745342 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaaf4f7-3ff6-4724-a2d3-97c1611a5795 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:30.844386 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef750147-58ee-471d-aaa2-d309bb739f7f None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:30.856331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaaf4f7-3ff6-4724-a2d3-97c1611a5795 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:30.880405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62b3ab-4847-4b37-a2bb-9d4377b86447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:30.881367 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62b3ab-4847-4b37-a2bb-9d4377b86447 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:30.881871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62b3ab-4847-4b37-a2bb-9d4377b86447 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:30.882343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62b3ab-4847-4b37-a2bb-9d4377b86447 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:30.883259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62b3ab-4847-4b37-a2bb-9d4377b86447 None admin] RBAC: Adding query filter params (name=member) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:30.883913 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62b3ab-4847-4b37-a2bb-9d4377b86447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:30.885515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62b3ab-4847-4b37-a2bb-9d4377b86447 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:30.893073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501b5ce-0a63-44ac-9826-f8e18980b793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:30.893701 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501b5ce-0a63-44ac-9826-f8e18980b793 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:30.893977 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501b5ce-0a63-44ac-9826-f8e18980b793 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:30.894246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501b5ce-0a63-44ac-9826-f8e18980b793 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:30.895628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 37/71] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:17:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:30.899936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62b3ab-4847-4b37-a2bb-9d4377b86447 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:30.908117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501b5ce-0a63-44ac-9826-f8e18980b793 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:30.913512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-c501b5ce-0a63-44ac-9826-f8e18980b793 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:17:30.913512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:30.913512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:30.913512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:30.913512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:30.913512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:30.913512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:30.913512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:30.913512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:30.913512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:30.913512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:30.913512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:30.913512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:30.913512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:30.913512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:30.913512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:30.914372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:30.914372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:30.914372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:30.914372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:30.914372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:30.914372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:30.914372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:30.914372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:30.914372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:30.914372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:30.914372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:30.914372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:30.914372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:30.914372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:30.914372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:30.914372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:30.915202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:30.915202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:30.915202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:30.915202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:30.915202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:30.915202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:30.915202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:30.915202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:30.915202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:30.915202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:30.915202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:17:30.915202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:17:30.915202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 35/72] 10.222.0.25 () {56 vars in 1114 bytes} [Sat Sep 24 19:17:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:30.915831 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501b5ce-0a63-44ac-9826-f8e18980b793 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:30.946162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:30.967017 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:31.018636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62b3ab-4847-4b37-a2bb-9d4377b86447 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:31.025350 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501b5ce-0a63-44ac-9826-f8e18980b793 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:31.054125 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5eac6-c4d5-40b5-a2d8-28ef2a7c9c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:31.054763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5eac6-c4d5-40b5-a2d8-28ef2a7c9c7e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:31.055080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5eac6-c4d5-40b5-a2d8-28ef2a7c9c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:31.055357 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5eac6-c4d5-40b5-a2d8-28ef2a7c9c7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:31.062592 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3241c47-dd21-4ab9-a759-00a61762a0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:31.063244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3241c47-dd21-4ab9-a759-00a61762a0ec None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:31.063534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3241c47-dd21-4ab9-a759-00a61762a0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:31.063812 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3241c47-dd21-4ab9-a759-00a61762a0ec None admin] PATH_INFO: `/v3/users/e80900aed4204d569a981d6b2e257d13` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:31.066351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5eac6-c4d5-40b5-a2d8-28ef2a7c9c7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:31.071763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-bcf5eac6-c4d5-40b5-a2d8-28ef2a7c9c7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:17:31.071763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:31.071763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:31.071763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:31.071763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:31.071763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:31.071763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:31.071763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:31.071763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:31.071763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:31.071763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:31.071763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:31.071763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:31.071763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:31.071763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:31.071763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:31.072734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:31.072734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:31.072734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:31.072734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:31.072734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:31.072734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:31.072734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:31.072734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:31.072734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:31.072734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:31.072734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:31.072734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:31.072734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:31.072734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:31.072734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:31.072734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:31.073801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:31.073801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:31.073801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:31.073801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:31.073801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:31.073801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:31.073801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:31.073801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:31.073801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:31.073801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:31.073801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:17:31.073801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:17:31.073801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 38/73] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:17:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:31.075357 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc78a0-1bf8-4902-9135-23ea555708e6 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:31.075357 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc78a0-1bf8-4902-9135-23ea555708e6 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:31.075357 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc78a0-1bf8-4902-9135-23ea555708e6 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:31.078951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 39/74] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:31.078951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc78a0-1bf8-4902-9135-23ea555708e6 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:31.080538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3241c47-dd21-4ab9-a759-00a61762a0ec None admin] RBAC: Authorizing `identity:get_user(user_id=e80900aed4204d569a981d6b2e257d13)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:31.082041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3241c47-dd21-4ab9-a759-00a61762a0ec None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:31.083725 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 36/75] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:30 2022] GET /identity/v3/users/e80900aed4204d569a981d6b2e257d13 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:31.084486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3241c47-dd21-4ab9-a759-00a61762a0ec None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:31.173588 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:31.181338 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc78a0-1bf8-4902-9135-23ea555708e6 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:31.182053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3241c47-dd21-4ab9-a759-00a61762a0ec None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:31.185095 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:31.215242 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de863a6-e0fe-43d9-ad01-f65342900296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:31.215853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de863a6-e0fe-43d9-ad01-f65342900296 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:31.216135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de863a6-e0fe-43d9-ad01-f65342900296 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:31.216409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de863a6-e0fe-43d9-ad01-f65342900296 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:31.217066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de863a6-e0fe-43d9-ad01-f65342900296 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:31.217193 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ba183-90c8-46a1-88a4-7d15f7c2101d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:31.217370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de863a6-e0fe-43d9-ad01-f65342900296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:31.217812 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ba183-90c8-46a1-88a4-7d15f7c2101d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:31.218089 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ba183-90c8-46a1-88a4-7d15f7c2101d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:31.218362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ba183-90c8-46a1-88a4-7d15f7c2101d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:31.218754 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de863a6-e0fe-43d9-ad01-f65342900296 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:31.227028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 40/76] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:17:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:31.227825 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de863a6-e0fe-43d9-ad01-f65342900296 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:31.228556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ba183-90c8-46a1-88a4-7d15f7c2101d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:31.234470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-136ba183-90c8-46a1-88a4-7d15f7c2101d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:17:31.234470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:31.234470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:31.234470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:31.234470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:31.234470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:31.234470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:31.234470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:31.234470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:31.234470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:31.234470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:31.234470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:31.234470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:31.234470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:31.234470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:31.234470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:31.235492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:31.235492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:31.235492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:31.235492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:31.235492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:31.235492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:31.235492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:31.235492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:31.235492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:31.235492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:31.235492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:31.235492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:31.235492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:31.235492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:31.235492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:31.235492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:31.239694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:31.239694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:31.239694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:31.239694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:31.239694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:31.239694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:31.239694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:31.239694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:31.239694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:31.239694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:31.239694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:17:31.239694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:17:31.239694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 37/77] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:17:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:31.239694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79bd5-9fdd-485f-92d9-0cda6933ec54 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:31.240387 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79bd5-9fdd-485f-92d9-0cda6933ec54 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:31.240387 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79bd5-9fdd-485f-92d9-0cda6933ec54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:31.255601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-bcb79bd5-9fdd-485f-92d9-0cda6933ec54 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:31.256800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-bcb79bd5-9fdd-485f-92d9-0cda6933ec54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:31.322553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 38/78] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:31.323409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb79bd5-9fdd-485f-92d9-0cda6933ec54 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:31.330446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de863a6-e0fe-43d9-ad01-f65342900296 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:31.367140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31761bf9-3597-47f7-89a6-d8f0f1cae76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:31.367960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31761bf9-3597-47f7-89a6-d8f0f1cae76e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:31.368407 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31761bf9-3597-47f7-89a6-d8f0f1cae76e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:31.368937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31761bf9-3597-47f7-89a6-d8f0f1cae76e None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:31.369595 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31761bf9-3597-47f7-89a6-d8f0f1cae76e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:31.370022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31761bf9-3597-47f7-89a6-d8f0f1cae76e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:31.371968 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31761bf9-3597-47f7-89a6-d8f0f1cae76e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:31.381769 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 41/79] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:17:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:31.382583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31761bf9-3597-47f7-89a6-d8f0f1cae76e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:31.404227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:31.437835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:31.445311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb79bd5-9fdd-485f-92d9-0cda6933ec54 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:31.480457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef402f1-8835-43a2-88a4-4d5559612aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:31.481906 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef402f1-8835-43a2-88a4-4d5559612aaa None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:31.482363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef402f1-8835-43a2-88a4-4d5559612aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:31.482804 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef402f1-8835-43a2-88a4-4d5559612aaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:31.520445 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31761bf9-3597-47f7-89a6-d8f0f1cae76e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:31.560750 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e38a39-3b05-42bb-93f2-4ae98f5d91e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:31.561695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e38a39-3b05-42bb-93f2-4ae98f5d91e6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:31.562118 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e38a39-3b05-42bb-93f2-4ae98f5d91e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:31.562563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e38a39-3b05-42bb-93f2-4ae98f5d91e6 None admin] PATH_INFO: `/v3/users/e80900aed4204d569a981d6b2e257d13` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:31.563998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e38a39-3b05-42bb-93f2-4ae98f5d91e6 None admin] RBAC: Authorizing `identity:get_user(user_id=e80900aed4204d569a981d6b2e257d13)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:31.565606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e38a39-3b05-42bb-93f2-4ae98f5d91e6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:31.567461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 42/80] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:31 2022] GET /identity/v3/users/e80900aed4204d569a981d6b2e257d13 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:31.568400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e38a39-3b05-42bb-93f2-4ae98f5d91e6 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:31.667940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:31.672575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef402f1-8835-43a2-88a4-4d5559612aaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:31.674226 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef402f1-8835-43a2-88a4-4d5559612aaa None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:31.684917 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e38a39-3b05-42bb-93f2-4ae98f5d91e6 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:31.720541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dde138-c8d3-49ba-9656-42281c7d5800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:31.721256 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dde138-c8d3-49ba-9656-42281c7d5800 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:31.721610 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dde138-c8d3-49ba-9656-42281c7d5800 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:31.721960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dde138-c8d3-49ba-9656-42281c7d5800 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:31.722684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dde138-c8d3-49ba-9656-42281c7d5800 None admin] RBAC: Adding query filter params (name=member) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:31.723084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dde138-c8d3-49ba-9656-42281c7d5800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:31.724762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dde138-c8d3-49ba-9656-42281c7d5800 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:31.734613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 43/81] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:17:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:31.735657 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dde138-c8d3-49ba-9656-42281c7d5800 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:31.779108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:31.787362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 39/82] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:17:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:17:31.788182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef402f1-8835-43a2-88a4-4d5559612aaa None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:31.845369 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dde138-c8d3-49ba-9656-42281c7d5800 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:31.881826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50266092-6531-4372-ba50-bb591ebab295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:31.882462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50266092-6531-4372-ba50-bb591ebab295 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:31.882740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50266092-6531-4372-ba50-bb591ebab295 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:31.883047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50266092-6531-4372-ba50-bb591ebab295 None admin] PATH_INFO: `/v3/users/a348fc63930b48c2bf96319b964824d3` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:31.884189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50266092-6531-4372-ba50-bb591ebab295 None admin] RBAC: Authorizing `identity:get_user(user_id=a348fc63930b48c2bf96319b964824d3)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:31.885623 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50266092-6531-4372-ba50-bb591ebab295 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:31.887241 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 44/83] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:31 2022] GET /identity/v3/users/a348fc63930b48c2bf96319b964824d3 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:31.888094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50266092-6531-4372-ba50-bb591ebab295 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:31.892327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef402f1-8835-43a2-88a4-4d5559612aaa None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:31.906746 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:31.927213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2d4b5-cb93-448e-a3a4-d6e24592b3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:31.927817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2d4b5-cb93-448e-a3a4-d6e24592b3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:31.928096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2d4b5-cb93-448e-a3a4-d6e24592b3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:31.928364 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2d4b5-cb93-448e-a3a4-d6e24592b3b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:31.987190 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:31.987796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50266092-6531-4372-ba50-bb591ebab295 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:31.994761 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2d4b5-cb93-448e-a3a4-d6e24592b3b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:31.996358 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2d4b5-cb93-448e-a3a4-d6e24592b3b1 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:32.021587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477fbac-6206-4333-833a-e3d01eca46f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:32.022222 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477fbac-6206-4333-833a-e3d01eca46f3 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:32.022506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477fbac-6206-4333-833a-e3d01eca46f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:32.022783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477fbac-6206-4333-833a-e3d01eca46f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:32.024190 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477fbac-6206-4333-833a-e3d01eca46f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:32.025639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477fbac-6206-4333-833a-e3d01eca46f3 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:32.027247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 45/84] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:17:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:32.028558 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477fbac-6206-4333-833a-e3d01eca46f3 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:32.098790 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 40/85] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:17:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:17:32.100215 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2d4b5-cb93-448e-a3a4-d6e24592b3b1 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:32.111690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:32.128452 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477fbac-6206-4333-833a-e3d01eca46f3 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:32.170022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cf716-62f3-431c-8c4e-cefe711f3056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:32.170691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cf716-62f3-431c-8c4e-cefe711f3056 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:32.171014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cf716-62f3-431c-8c4e-cefe711f3056 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:32.171359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cf716-62f3-431c-8c4e-cefe711f3056 None admin] PATH_INFO: `/v3/users/e80900aed4204d569a981d6b2e257d13` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:32.172521 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4cf716-62f3-431c-8c4e-cefe711f3056 None admin] RBAC: Authorizing `identity:get_user(user_id=e80900aed4204d569a981d6b2e257d13)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:32.173989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4cf716-62f3-431c-8c4e-cefe711f3056 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:32.175613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 46/86] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:32 2022] GET /identity/v3/users/e80900aed4204d569a981d6b2e257d13 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:32.176423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cf716-62f3-431c-8c4e-cefe711f3056 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:32.199701 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:32.207527 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2d4b5-cb93-448e-a3a4-d6e24592b3b1 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:32.240746 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fefc31-ebc9-4842-8771-9006f9e3123c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:32.241301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fefc31-ebc9-4842-8771-9006f9e3123c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:32.241581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fefc31-ebc9-4842-8771-9006f9e3123c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:32.241878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fefc31-ebc9-4842-8771-9006f9e3123c None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:32.243034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fefc31-ebc9-4842-8771-9006f9e3123c None admin] RBAC: Authorizing `identity:get_project(project_id=9bbb5023e47c45f49813194c41890827)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:32.244476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fefc31-ebc9-4842-8771-9006f9e3123c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:32.246097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 41/87] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:32 2022] GET /identity/v3/projects/9bbb5023e47c45f49813194c41890827 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:32.247431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fefc31-ebc9-4842-8771-9006f9e3123c None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:32.275246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cf716-62f3-431c-8c4e-cefe711f3056 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:32.310160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c706978-6723-4dfd-8b10-a97046d0beb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:32.310770 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c706978-6723-4dfd-8b10-a97046d0beb8 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:32.311081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c706978-6723-4dfd-8b10-a97046d0beb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:32.311360 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c706978-6723-4dfd-8b10-a97046d0beb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:32.333093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:32.349345 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fefc31-ebc9-4842-8771-9006f9e3123c None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:32.379691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c706978-6723-4dfd-8b10-a97046d0beb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:32.381163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c706978-6723-4dfd-8b10-a97046d0beb8 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:32.382761 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6479564-481c-450b-adc3-8da48598b3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:32.383396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6479564-481c-450b-adc3-8da48598b3c2 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:32.383682 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6479564-481c-450b-adc3-8da48598b3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:32.383960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6479564-481c-450b-adc3-8da48598b3c2 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:32.384607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6479564-481c-450b-adc3-8da48598b3c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:32.386028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6479564-481c-450b-adc3-8da48598b3c2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:32.414309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 42/88] 10.222.0.25 () {60 vars in 1132 bytes} [Sat Sep 24 19:17:32 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:17:32.415380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6479564-481c-450b-adc3-8da48598b3c2 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:32.446536 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:32.500515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 47/89] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:17:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:17:32.501680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c706978-6723-4dfd-8b10-a97046d0beb8 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:32.548162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6479564-481c-450b-adc3-8da48598b3c2 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:32.564423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:32.592603 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14862ab-a4bc-472e-b2da-7f5ee696a33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:32.592603 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14862ab-a4bc-472e-b2da-7f5ee696a33d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:32.592603 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14862ab-a4bc-472e-b2da-7f5ee696a33d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:32.592603 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14862ab-a4bc-472e-b2da-7f5ee696a33d None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:32.593811 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14862ab-a4bc-472e-b2da-7f5ee696a33d None admin] RBAC: Authorizing `identity:get_project(project_id=9bbb5023e47c45f49813194c41890827)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:32.595341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14862ab-a4bc-472e-b2da-7f5ee696a33d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:32.597058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 43/90] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:32 2022] GET /identity/v3/projects/9bbb5023e47c45f49813194c41890827 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:32.597817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14862ab-a4bc-472e-b2da-7f5ee696a33d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:32.631832 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c706978-6723-4dfd-8b10-a97046d0beb8 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:32.670845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695917f-0632-44db-8730-a0ebf343af26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:32.671476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695917f-0632-44db-8730-a0ebf343af26 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:32.671755 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695917f-0632-44db-8730-a0ebf343af26 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:32.672079 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695917f-0632-44db-8730-a0ebf343af26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:32.700797 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:32.720760 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14862ab-a4bc-472e-b2da-7f5ee696a33d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:32.758608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695917f-0632-44db-8730-a0ebf343af26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:32.760038 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695917f-0632-44db-8730-a0ebf343af26 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:32.770276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee26ad-c14a-4bec-8045-c94790daa097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:32.770978 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee26ad-c14a-4bec-8045-c94790daa097 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:32.771271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee26ad-c14a-4bec-8045-c94790daa097 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:32.771552 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee26ad-c14a-4bec-8045-c94790daa097 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:32.772668 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee26ad-c14a-4bec-8045-c94790daa097 None admin] RBAC: Adding query filter params (role.id=ef0525432e044dd18b3ae4b32d29030e, scope.project.id=9bbb5023e47c45f49813194c41890827, user.id=e80900aed4204d569a981d6b2e257d13) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:32.772982 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee26ad-c14a-4bec-8045-c94790daa097 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:32.775296 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee26ad-c14a-4bec-8045-c94790daa097 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:32.783182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 44/91] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:17:32 2022] GET /identity/v3/role_assignments?user.id=e80900aed4204d569a981d6b2e257d13&scope.project.id=9bbb5023e47c45f49813194c41890827&role.id=ef0525432e044dd18b3ae4b32d29030e => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:32.784188 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee26ad-c14a-4bec-8045-c94790daa097 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:32.838558 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:32.923225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 48/92] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:17:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:17:32.924115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695917f-0632-44db-8730-a0ebf343af26 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:33.030812 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee26ad-c14a-4bec-8045-c94790daa097 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:33.052979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695917f-0632-44db-8730-a0ebf343af26 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:33.083387 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2c393-283c-401e-8df1-931f8ad8e152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:33.084030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2c393-283c-401e-8df1-931f8ad8e152 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:33.084307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2c393-283c-401e-8df1-931f8ad8e152 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:33.084579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2c393-283c-401e-8df1-931f8ad8e152 None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:33.086878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2c393-283c-401e-8df1-931f8ad8e152 None admin] RBAC: Authorizing `identity:get_project(project_id=9bbb5023e47c45f49813194c41890827)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:33.088374 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2c393-283c-401e-8df1-931f8ad8e152 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:33.090221 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 45/93] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:32 2022] GET /identity/v3/projects/9bbb5023e47c45f49813194c41890827 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:33.094903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2c393-283c-401e-8df1-931f8ad8e152 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:33.122543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67002707-9872-4270-bf58-bc33d80171d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:33.123185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67002707-9872-4270-bf58-bc33d80171d5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:33.123467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67002707-9872-4270-bf58-bc33d80171d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:33.123739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67002707-9872-4270-bf58-bc33d80171d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:33.124473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67002707-9872-4270-bf58-bc33d80171d5 None admin] RBAC: Adding query filter params (role.id=655c93c88bc34badbfd2aad45491a96b, scope.project.id=9bbb5023e47c45f49813194c41890827, user.id=e80900aed4204d569a981d6b2e257d13) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:33.124783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67002707-9872-4270-bf58-bc33d80171d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:33.126226 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67002707-9872-4270-bf58-bc33d80171d5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:33.134640 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 49/94] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:17:32 2022] GET /identity/v3/role_assignments?user.id=e80900aed4204d569a981d6b2e257d13&scope.project.id=9bbb5023e47c45f49813194c41890827&role.id=655c93c88bc34badbfd2aad45491a96b => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:33.138408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67002707-9872-4270-bf58-bc33d80171d5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:33.139203 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:33.177755 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:33.289595 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2c393-283c-401e-8df1-931f8ad8e152 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:33.329333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67002707-9872-4270-bf58-bc33d80171d5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:33.355777 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f8c5b-1a40-409c-8de1-628175c75c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:33.356446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f8c5b-1a40-409c-8de1-628175c75c7a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:33.356700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f8c5b-1a40-409c-8de1-628175c75c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:33.356976 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f8c5b-1a40-409c-8de1-628175c75c7a None admin] PATH_INFO: `/v3/projects/c89e1d4dcb894ce2a06be56a6d91c3e6` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:33.359047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f8c5b-1a40-409c-8de1-628175c75c7a None admin] RBAC: Authorizing `identity:get_project(project_id=c89e1d4dcb894ce2a06be56a6d91c3e6)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:33.360501 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f8c5b-1a40-409c-8de1-628175c75c7a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:33.365574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 46/95] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:33 2022] GET /identity/v3/projects/c89e1d4dcb894ce2a06be56a6d91c3e6 => generated 312 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:33.369167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f8c5b-1a40-409c-8de1-628175c75c7a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:33.396184 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec64c6-d771-48a5-aeed-6c8105e1abc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:33.396812 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec64c6-d771-48a5-aeed-6c8105e1abc7 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:33.397094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec64c6-d771-48a5-aeed-6c8105e1abc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:33.397369 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec64c6-d771-48a5-aeed-6c8105e1abc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:33.398110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec64c6-d771-48a5-aeed-6c8105e1abc7 None admin] RBAC: Adding query filter params (role.id=dd27845a836a4f6ebece149dbebc59c0, scope.project.id=9bbb5023e47c45f49813194c41890827, user.id=a348fc63930b48c2bf96319b964824d3) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:33.398908 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec64c6-d771-48a5-aeed-6c8105e1abc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:33.401823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec64c6-d771-48a5-aeed-6c8105e1abc7 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:33.417450 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 50/96] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:17:33 2022] GET /identity/v3/role_assignments?user.id=a348fc63930b48c2bf96319b964824d3&scope.project.id=9bbb5023e47c45f49813194c41890827&role.id=dd27845a836a4f6ebece149dbebc59c0 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:33.512602 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:33.534223 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f8c5b-1a40-409c-8de1-628175c75c7a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:33.578929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c847f-0a2b-4ef7-bc24-07cdcd37bf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:33.579463 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c847f-0a2b-4ef7-bc24-07cdcd37bf16 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:33.579796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c847f-0a2b-4ef7-bc24-07cdcd37bf16 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:33.580075 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c847f-0a2b-4ef7-bc24-07cdcd37bf16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:33.580822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c847f-0a2b-4ef7-bc24-07cdcd37bf16 None admin] RBAC: Adding query filter params (role.id=ef0525432e044dd18b3ae4b32d29030e, scope.project.id=c89e1d4dcb894ce2a06be56a6d91c3e6, user.id=e80900aed4204d569a981d6b2e257d13) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:33.581133 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c847f-0a2b-4ef7-bc24-07cdcd37bf16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:33.582609 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c847f-0a2b-4ef7-bc24-07cdcd37bf16 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:33.591893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 47/97] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:17:33 2022] GET /identity/v3/role_assignments?user.id=e80900aed4204d569a981d6b2e257d13&scope.project.id=c89e1d4dcb894ce2a06be56a6d91c3e6&role.id=ef0525432e044dd18b3ae4b32d29030e => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:35.125012 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef611d-4ad9-4361-b92e-d0b5799fae1d None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:35.126004 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef611d-4ad9-4361-b92e-d0b5799fae1d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:35.126489 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef611d-4ad9-4361-b92e-d0b5799fae1d None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:35.128075 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 51/98] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:35.133686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999683e-71a8-4be0-9573-52b78ececf9f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:35.134530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999683e-71a8-4be0-9573-52b78ececf9f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:35.135078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999683e-71a8-4be0-9573-52b78ececf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:35.154953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-e999683e-71a8-4be0-9573-52b78ececf9f None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:35.156467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e999683e-71a8-4be0-9573-52b78ececf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:35.236899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 48/99] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:35.325733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce8cb6-cb76-4eaa-94a5-d417db0791e1 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:35.326158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce8cb6-cb76-4eaa-94a5-d417db0791e1 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:35.326322 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce8cb6-cb76-4eaa-94a5-d417db0791e1 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:35.327677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 52/100] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:35.332876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dfd0e-f981-414a-b1e7-175285a11827 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:35.333166 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dfd0e-f981-414a-b1e7-175285a11827 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:35.333439 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dfd0e-f981-414a-b1e7-175285a11827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:35.351745 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-6b9dfd0e-f981-414a-b1e7-175285a11827 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:35.352919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6b9dfd0e-f981-414a-b1e7-175285a11827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:35.425369 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 49/101] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:35.716461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce8cb6-cb76-4eaa-94a5-d417db0791e1 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:35.821379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dfd0e-f981-414a-b1e7-175285a11827 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:35.826173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:35.844047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:35.852450 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce8cb6-cb76-4eaa-94a5-d417db0791e1 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:35.907135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b77d1-c04c-4a94-b918-5c5836322866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:35.907774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b77d1-c04c-4a94-b918-5c5836322866 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:35.908052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b77d1-c04c-4a94-b918-5c5836322866 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:35.908329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b77d1-c04c-4a94-b918-5c5836322866 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:35.909491 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b77d1-c04c-4a94-b918-5c5836322866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:35.917864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b77d1-c04c-4a94-b918-5c5836322866 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:35.920904 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 53/102] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:17:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:35.926393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b77d1-c04c-4a94-b918-5c5836322866 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:36.029010 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dfd0e-f981-414a-b1e7-175285a11827 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:36.101266 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751e788-a1d7-46fb-8741-97c86dfac88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:36.101910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751e788-a1d7-46fb-8741-97c86dfac88f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:36.102184 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751e788-a1d7-46fb-8741-97c86dfac88f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:36.102455 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751e788-a1d7-46fb-8741-97c86dfac88f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:36.102557 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b77d1-c04c-4a94-b918-5c5836322866 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:36.135902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751e788-a1d7-46fb-8741-97c86dfac88f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:36.140607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8f5a4-96a2-43eb-b7fd-e40e15b1618f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:36.141110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-8751e788-a1d7-46fb-8741-97c86dfac88f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:17:36.141110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:36.141110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:36.141110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:36.141110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:36.141110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:36.141110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:36.141110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:36.141110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:36.141110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:36.141110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:36.141110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:36.141110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:36.141110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:36.141110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:36.141110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:36.141918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:36.141918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:36.141918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:36.141918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:36.141918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:36.141918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:36.141918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:36.141918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:36.141918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:36.141918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:36.141918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:36.141918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:36.141918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:36.141918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:36.141918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:36.141918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:36.143112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:36.143112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:36.143112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:36.143112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:36.143112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:36.143112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:36.143112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:36.143112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:36.143112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:36.143112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:36.143112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:17:36.143112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:17:36.143894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8f5a4-96a2-43eb-b7fd-e40e15b1618f None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:36.143894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8f5a4-96a2-43eb-b7fd-e40e15b1618f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:36.143894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8f5a4-96a2-43eb-b7fd-e40e15b1618f None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:36.144081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 50/103] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:17:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:17:36.144145 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8f5a4-96a2-43eb-b7fd-e40e15b1618f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:36.144145 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8f5a4-96a2-43eb-b7fd-e40e15b1618f None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:36.151744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751e788-a1d7-46fb-8741-97c86dfac88f None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:36.172302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:36.187722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 54/104] 10.222.0.25 () {60 vars in 1141 bytes} [Sat Sep 24 19:17:35 2022] POST /identity/v3/projects => generated 302 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:17:36.259450 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:36.305905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751e788-a1d7-46fb-8741-97c86dfac88f None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:36.364966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892be5b5-6d76-4d2c-a7f6-06bc31c6764e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:36.365940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892be5b5-6d76-4d2c-a7f6-06bc31c6764e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:36.366436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892be5b5-6d76-4d2c-a7f6-06bc31c6764e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:36.366923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892be5b5-6d76-4d2c-a7f6-06bc31c6764e None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:36.368657 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892be5b5-6d76-4d2c-a7f6-06bc31c6764e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:36.369170 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892be5b5-6d76-4d2c-a7f6-06bc31c6764e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:36.370778 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892be5b5-6d76-4d2c-a7f6-06bc31c6764e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:36.380677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 51/105] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:17:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:17:36.386569 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8f5a4-96a2-43eb-b7fd-e40e15b1618f None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:36.513998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8f5a4-96a2-43eb-b7fd-e40e15b1618f None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:36.552462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a873c9b-29b9-47a8-8b18-a32957298c77 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:36.552772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a873c9b-29b9-47a8-8b18-a32957298c77 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:36.553098 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a873c9b-29b9-47a8-8b18-a32957298c77 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:36.554432 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 52/106] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:17:36.556522 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742f3f9-e4e0-494b-8c08-983b07018515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:36.557109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742f3f9-e4e0-494b-8c08-983b07018515 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:36.557387 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742f3f9-e4e0-494b-8c08-983b07018515 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:36.557649 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742f3f9-e4e0-494b-8c08-983b07018515 None admin] PATH_INFO: `/v3/users/09008a3af37a418cab1a930f2af79f83` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:36.561085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f7936-1d8a-433e-8784-18f5d64202ec None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:36.561361 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f7936-1d8a-433e-8784-18f5d64202ec None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:36.561632 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f7936-1d8a-433e-8784-18f5d64202ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:36.590389 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742f3f9-e4e0-494b-8c08-983b07018515 None admin] RBAC: Authorizing `identity:get_user(user_id=09008a3af37a418cab1a930f2af79f83)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:36.592238 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742f3f9-e4e0-494b-8c08-983b07018515 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:36.593948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 55/107] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:36 2022] GET /identity/v3/users/09008a3af37a418cab1a930f2af79f83 => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:36.595211 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-ce9f7936-1d8a-433e-8784-18f5d64202ec None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:36.596455 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-ce9f7936-1d8a-433e-8784-18f5d64202ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:36.599614 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742f3f9-e4e0-494b-8c08-983b07018515 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:36.667556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:36.713271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 53/108] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:17:36.718054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742f3f9-e4e0-494b-8c08-983b07018515 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:36.756049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea049643-c713-4128-8998-6fff15cef0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:36.756687 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea049643-c713-4128-8998-6fff15cef0cb None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:36.756972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea049643-c713-4128-8998-6fff15cef0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:36.757245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea049643-c713-4128-8998-6fff15cef0cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:36.840639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea049643-c713-4128-8998-6fff15cef0cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:36.842258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea049643-c713-4128-8998-6fff15cef0cb None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:36.894700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048fb12-9d9d-4272-9505-f166c910a11d None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:36.895041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048fb12-9d9d-4272-9505-f166c910a11d None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:36.895289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048fb12-9d9d-4272-9505-f166c910a11d None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:36.896807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 54/109] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:17:36.904426 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4714dc0-071c-4015-b92a-132d24ce2f98 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:36.904722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4714dc0-071c-4015-b92a-132d24ce2f98 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:36.904962 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4714dc0-071c-4015-b92a-132d24ce2f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:36.910871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:36.937324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-c4714dc0-071c-4015-b92a-132d24ce2f98 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:36.938527 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c4714dc0-071c-4015-b92a-132d24ce2f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:36.960060 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 56/110] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:17:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 19:17:36.966141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea049643-c713-4128-8998-6fff15cef0cb None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:37.036945 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:37.050753 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 55/111] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:37.052058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aea22e-8d88-4ad8-9308-e13fb7797908 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:37.052440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aea22e-8d88-4ad8-9308-e13fb7797908 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:37.052721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aea22e-8d88-4ad8-9308-e13fb7797908 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:37.054085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 56/112] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:37.060168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c263a03-4dac-47a0-85aa-bd01a510fce0 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:37.060556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c263a03-4dac-47a0-85aa-bd01a510fce0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:37.060842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c263a03-4dac-47a0-85aa-bd01a510fce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:37.077311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea049643-c713-4128-8998-6fff15cef0cb None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:37.089977 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-0c263a03-4dac-47a0-85aa-bd01a510fce0 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:37.095488 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-0c263a03-4dac-47a0-85aa-bd01a510fce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:37.115446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fa1b3-c512-46a3-b35c-71da26e7c4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:37.116081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fa1b3-c512-46a3-b35c-71da26e7c4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:37.116823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fa1b3-c512-46a3-b35c-71da26e7c4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:37.117105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fa1b3-c512-46a3-b35c-71da26e7c4d7 None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:37.118501 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fa1b3-c512-46a3-b35c-71da26e7c4d7 None admin] RBAC: Authorizing `identity:get_project(project_id=9bbb5023e47c45f49813194c41890827)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:37.120493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fa1b3-c512-46a3-b35c-71da26e7c4d7 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:37.124233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 57/113] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:36 2022] GET /identity/v3/projects/9bbb5023e47c45f49813194c41890827 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:37.128784 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ecedf-ef17-4c78-aec5-ea1236b9c8f7 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:37.128784 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ecedf-ef17-4c78-aec5-ea1236b9c8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:37.128784 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ecedf-ef17-4c78-aec5-ea1236b9c8f7 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:37.128784 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 58/114] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:37.129415 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ecedf-ef17-4c78-aec5-ea1236b9c8f7 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:37.174777 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:37.180765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 57/115] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:17:37.182069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c263a03-4dac-47a0-85aa-bd01a510fce0 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:37.295579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c263a03-4dac-47a0-85aa-bd01a510fce0 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:37.319114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ecedf-ef17-4c78-aec5-ea1236b9c8f7 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:37.323151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:37.335898 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966d7ad-7e5f-4bf9-a4f2-ceb971dfcc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:37.336762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966d7ad-7e5f-4bf9-a4f2-ceb971dfcc1e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:37.337694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966d7ad-7e5f-4bf9-a4f2-ceb971dfcc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:37.338121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966d7ad-7e5f-4bf9-a4f2-ceb971dfcc1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:37.339041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966d7ad-7e5f-4bf9-a4f2-ceb971dfcc1e None admin] RBAC: Adding query filter params (role.id=4b618f407f654e32a6a29da3aa4f83e2, scope.project.id=9bbb5023e47c45f49813194c41890827, user.id=09008a3af37a418cab1a930f2af79f83) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:37.339497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966d7ad-7e5f-4bf9-a4f2-ceb971dfcc1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:37.341196 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966d7ad-7e5f-4bf9-a4f2-ceb971dfcc1e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:37.348655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 58/116] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:17:37 2022] GET /identity/v3/role_assignments?user.id=09008a3af37a418cab1a930f2af79f83&scope.project.id=9bbb5023e47c45f49813194c41890827&role.id=4b618f407f654e32a6a29da3aa4f83e2 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:37.354867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70610eb5-c452-4240-b73d-8dabbee3efc4 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:37.355300 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70610eb5-c452-4240-b73d-8dabbee3efc4 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:37.356140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70610eb5-c452-4240-b73d-8dabbee3efc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:37.391689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-70610eb5-c452-4240-b73d-8dabbee3efc4 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:37.392927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-70610eb5-c452-4240-b73d-8dabbee3efc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:37.398091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e756d6-d446-449d-a901-65894441442a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:37.399413 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e756d6-d446-449d-a901-65894441442a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:37.399913 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e756d6-d446-449d-a901-65894441442a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:37.400384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e756d6-d446-449d-a901-65894441442a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:37.434817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e756d6-d446-449d-a901-65894441442a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:37.440903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-22e756d6-d446-449d-a901-65894441442a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:17:37.440903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:37.440903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:37.440903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:37.440903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:37.440903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:37.440903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:37.440903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:37.440903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:37.440903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:37.440903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:37.440903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:37.440903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:37.440903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:37.440903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:37.440903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:37.441819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:37.441819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:37.441819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:37.441819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:37.441819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:37.441819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:37.441819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:37.441819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:37.441819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:37.441819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:37.441819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:37.441819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:37.441819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:37.441819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:37.441819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:37.441819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:37.442572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:37.442572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:37.442572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:37.442572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:37.442572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:37.442572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:37.442572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:37.442572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:37.442572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:37.442572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:37.442572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:17:37.442572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:17:37.451586 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 59/117] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:17:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:37.454184 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e756d6-d446-449d-a901-65894441442a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:37.524987 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 59/118] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:37.526085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70610eb5-c452-4240-b73d-8dabbee3efc4 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:37.606025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:37.623399 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e756d6-d446-449d-a901-65894441442a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:37.661542 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820ccb4-1913-4144-8eae-2b78ef096d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:37.662454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820ccb4-1913-4144-8eae-2b78ef096d2e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:37.662916 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820ccb4-1913-4144-8eae-2b78ef096d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:37.663329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820ccb4-1913-4144-8eae-2b78ef096d2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:37.674004 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70610eb5-c452-4240-b73d-8dabbee3efc4 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:37.675669 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820ccb4-1913-4144-8eae-2b78ef096d2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:37.681076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-a820ccb4-1913-4144-8eae-2b78ef096d2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:17:37.681076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:37.681076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:37.681076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:37.681076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:37.681076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:37.681076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:37.681076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:37.681076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:37.681076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:37.681076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:37.681076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:37.681076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:37.681076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:37.681076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:37.681076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:37.682087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:37.682087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:37.682087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:37.682087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:37.682087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:37.682087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:37.682087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:37.682087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:37.682087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:37.682087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:37.682087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:37.682087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:37.682087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:37.682087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:37.682087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:37.682087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:37.683073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:37.683073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:37.683073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:37.683073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:37.683073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:37.683073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:37.683073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:37.683073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:37.683073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:37.683073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:37.683073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:17:37.683073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:17:37.685105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 60/119] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:17:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:37.686139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820ccb4-1913-4144-8eae-2b78ef096d2e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:37.692047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:37.716489 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705306f-4408-4eb9-b4ae-ad3c14482e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:37.717123 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705306f-4408-4eb9-b4ae-ad3c14482e21 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:37.717688 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705306f-4408-4eb9-b4ae-ad3c14482e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:37.717978 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705306f-4408-4eb9-b4ae-ad3c14482e21 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:37.718657 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705306f-4408-4eb9-b4ae-ad3c14482e21 None admin] RBAC: Adding query filter params (name=member) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:37.718996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705306f-4408-4eb9-b4ae-ad3c14482e21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:37.720639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705306f-4408-4eb9-b4ae-ad3c14482e21 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:37.732553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 60/120] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:17:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:37.733567 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705306f-4408-4eb9-b4ae-ad3c14482e21 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:37.801975 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820ccb4-1913-4144-8eae-2b78ef096d2e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:37.849872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705306f-4408-4eb9-b4ae-ad3c14482e21 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:37.855639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49dd46-dfae-4b55-a80d-2c40986b3c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:37.856668 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49dd46-dfae-4b55-a80d-2c40986b3c55 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:37.857151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49dd46-dfae-4b55-a80d-2c40986b3c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:37.857640 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49dd46-dfae-4b55-a80d-2c40986b3c55 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:37.880521 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49dd46-dfae-4b55-a80d-2c40986b3c55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:37.886158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-be49dd46-dfae-4b55-a80d-2c40986b3c55 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:17:37.886158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:37.886158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:37.886158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:37.886158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:37.886158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:37.886158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:37.886158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:37.886158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:37.886158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:37.886158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:37.886158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:37.886158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:37.886158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:37.886158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:37.886158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:37.887097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:37.887097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:37.887097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:37.887097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:37.887097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:37.887097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:37.887097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:37.887097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:37.887097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:37.887097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:37.887097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:37.887097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:37.887097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:37.887097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:37.887097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:37.887097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:37.887867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:37.887867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:37.887867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:37.887867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:37.887867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:37.887867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:37.887867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:37.887867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:37.887867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:37.887867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:37.887867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:17:37.887867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:17:37.890133 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 61/121] 10.222.0.25 () {56 vars in 1114 bytes} [Sat Sep 24 19:17:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:37.891193 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49dd46-dfae-4b55-a80d-2c40986b3c55 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:37.896691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f987b8d-b5e7-4892-9b09-7f16529cacad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:37.897040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f987b8d-b5e7-4892-9b09-7f16529cacad None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:37.897323 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f987b8d-b5e7-4892-9b09-7f16529cacad None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:37.897598 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f987b8d-b5e7-4892-9b09-7f16529cacad None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:37.898269 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f987b8d-b5e7-4892-9b09-7f16529cacad None admin] RBAC: Adding query filter params (name=member) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:37.898855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f987b8d-b5e7-4892-9b09-7f16529cacad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:37.900235 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f987b8d-b5e7-4892-9b09-7f16529cacad None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:37.910392 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:37.920187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 61/122] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:17:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:37.921055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f987b8d-b5e7-4892-9b09-7f16529cacad None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:37.984717 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:38.051572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49dd46-dfae-4b55-a80d-2c40986b3c55 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:38.059397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f987b8d-b5e7-4892-9b09-7f16529cacad None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:38.088263 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1c5f5-836a-4431-a784-32a641df95af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:38.089011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1c5f5-836a-4431-a784-32a641df95af None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:38.089305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1c5f5-836a-4431-a784-32a641df95af None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:38.089583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1c5f5-836a-4431-a784-32a641df95af None admin] PATH_INFO: `/v3/users/e80900aed4204d569a981d6b2e257d13` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:38.090994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1c5f5-836a-4431-a784-32a641df95af None admin] RBAC: Authorizing `identity:get_user(user_id=e80900aed4204d569a981d6b2e257d13)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:38.092479 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1c5f5-836a-4431-a784-32a641df95af None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:38.093812 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41a669-d2bb-426e-a063-8da38224080a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:38.094293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 62/123] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:37 2022] GET /identity/v3/users/e80900aed4204d569a981d6b2e257d13 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:38.094930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1c5f5-836a-4431-a784-32a641df95af None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:38.098837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41a669-d2bb-426e-a063-8da38224080a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:38.099174 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41a669-d2bb-426e-a063-8da38224080a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:38.099460 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41a669-d2bb-426e-a063-8da38224080a None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:38.100153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41a669-d2bb-426e-a063-8da38224080a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:38.100451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41a669-d2bb-426e-a063-8da38224080a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:38.101825 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41a669-d2bb-426e-a063-8da38224080a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:38.111845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 62/124] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:17:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:38.112681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41a669-d2bb-426e-a063-8da38224080a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:38.179755 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:38.210482 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1c5f5-836a-4431-a784-32a641df95af None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:38.219794 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41a669-d2bb-426e-a063-8da38224080a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:38.221249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:38.253989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d091677-74b2-4f95-a3d4-8c0d2e20e3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:38.254959 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d091677-74b2-4f95-a3d4-8c0d2e20e3cd None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:38.255411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d091677-74b2-4f95-a3d4-8c0d2e20e3cd None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:38.255872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d091677-74b2-4f95-a3d4-8c0d2e20e3cd None admin] PATH_INFO: `/v3/users/e80900aed4204d569a981d6b2e257d13` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:38.256742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6a978-3bb0-43b8-8668-bcaca489bc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:38.257029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d091677-74b2-4f95-a3d4-8c0d2e20e3cd None admin] RBAC: Authorizing `identity:get_user(user_id=e80900aed4204d569a981d6b2e257d13)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:38.257684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6a978-3bb0-43b8-8668-bcaca489bc76 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:38.258121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6a978-3bb0-43b8-8668-bcaca489bc76 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:38.258481 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d091677-74b2-4f95-a3d4-8c0d2e20e3cd None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:38.258675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6a978-3bb0-43b8-8668-bcaca489bc76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:38.260420 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 63/125] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:38 2022] GET /identity/v3/users/e80900aed4204d569a981d6b2e257d13 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:38.261391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d091677-74b2-4f95-a3d4-8c0d2e20e3cd None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:38.270869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6a978-3bb0-43b8-8668-bcaca489bc76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:38.276675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-1ae6a978-3bb0-43b8-8668-bcaca489bc76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:17:38.276675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:38.276675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:38.276675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:38.276675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:38.276675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:38.276675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:38.276675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:38.276675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:38.276675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:38.276675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:38.276675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:38.276675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:38.276675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:38.276675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:38.276675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:38.277641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:38.277641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:38.277641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:38.277641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:38.277641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:38.277641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:38.277641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:38.277641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:38.277641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:38.277641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:38.277641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:38.277641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:38.277641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:38.277641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:38.277641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:38.277641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:38.278624 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:38.278624 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:38.278624 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:38.278624 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:38.278624 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:38.278624 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:38.278624 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:38.278624 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:38.278624 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:38.278624 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:38.278624 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:17:38.278624 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:17:38.280686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 63/126] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:17:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:38.281801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6a978-3bb0-43b8-8668-bcaca489bc76 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:38.374254 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d091677-74b2-4f95-a3d4-8c0d2e20e3cd None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:38.384814 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6a978-3bb0-43b8-8668-bcaca489bc76 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:38.419068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455b805-4df0-4ea3-bc3e-442c6dab05aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:38.419626 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455b805-4df0-4ea3-bc3e-442c6dab05aa None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:38.419912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455b805-4df0-4ea3-bc3e-442c6dab05aa None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:38.420188 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455b805-4df0-4ea3-bc3e-442c6dab05aa None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:38.421623 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455b805-4df0-4ea3-bc3e-442c6dab05aa None admin] RBAC: Authorizing `identity:get_project(project_id=9bbb5023e47c45f49813194c41890827)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:38.423873 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455b805-4df0-4ea3-bc3e-442c6dab05aa None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:38.425515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 64/127] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:38 2022] GET /identity/v3/projects/9bbb5023e47c45f49813194c41890827 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:38.426671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455b805-4df0-4ea3-bc3e-442c6dab05aa None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:38.432056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badff08-6e92-47bd-9d04-601fed9cb0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:38.432936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badff08-6e92-47bd-9d04-601fed9cb0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:38.433391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badff08-6e92-47bd-9d04-601fed9cb0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:38.434354 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badff08-6e92-47bd-9d04-601fed9cb0b3 None admin] PATH_INFO: `/v3/users/e80900aed4204d569a981d6b2e257d13` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:38.435871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badff08-6e92-47bd-9d04-601fed9cb0b3 None admin] RBAC: Authorizing `identity:get_user(user_id=e80900aed4204d569a981d6b2e257d13)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:38.437512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badff08-6e92-47bd-9d04-601fed9cb0b3 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:38.439319 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 64/128] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:38 2022] GET /identity/v3/users/e80900aed4204d569a981d6b2e257d13 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:38.440395 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badff08-6e92-47bd-9d04-601fed9cb0b3 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:38.440730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:38.474324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:38.552587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badff08-6e92-47bd-9d04-601fed9cb0b3 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:38.571391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455b805-4df0-4ea3-bc3e-442c6dab05aa None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:38.597434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba169e11-b8f2-4dac-bbe7-9bd722432d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:38.598443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba169e11-b8f2-4dac-bbe7-9bd722432d04 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:38.598803 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba169e11-b8f2-4dac-bbe7-9bd722432d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:38.599114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba169e11-b8f2-4dac-bbe7-9bd722432d04 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:38.600072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba169e11-b8f2-4dac-bbe7-9bd722432d04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:38.600387 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba169e11-b8f2-4dac-bbe7-9bd722432d04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:38.602048 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba169e11-b8f2-4dac-bbe7-9bd722432d04 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:38.610657 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2154f3-148e-4083-8ded-add1e06a279c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:38.611584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2154f3-148e-4083-8ded-add1e06a279c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:38.612059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2154f3-148e-4083-8ded-add1e06a279c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:38.612180 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 65/129] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:17:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:38.612705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2154f3-148e-4083-8ded-add1e06a279c None admin] PATH_INFO: `/v3/projects/c89e1d4dcb894ce2a06be56a6d91c3e6` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:38.612974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba169e11-b8f2-4dac-bbe7-9bd722432d04 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:38.614510 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2154f3-148e-4083-8ded-add1e06a279c None admin] RBAC: Authorizing `identity:get_project(project_id=c89e1d4dcb894ce2a06be56a6d91c3e6)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:38.616195 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2154f3-148e-4083-8ded-add1e06a279c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:38.618766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 65/130] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:38 2022] GET /identity/v3/projects/c89e1d4dcb894ce2a06be56a6d91c3e6 => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:38.619913 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2154f3-148e-4083-8ded-add1e06a279c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:38.716553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:38.729305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:38.740758 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba169e11-b8f2-4dac-bbe7-9bd722432d04 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:38.746916 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2154f3-148e-4083-8ded-add1e06a279c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:38.779995 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a34682-118f-4214-b9e8-e0d5596f16dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:38.781147 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a34682-118f-4214-b9e8-e0d5596f16dc None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:38.781627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a34682-118f-4214-b9e8-e0d5596f16dc None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:38.782154 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a34682-118f-4214-b9e8-e0d5596f16dc None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827/users/e80900aed4204d569a981d6b2e257d13/roles/ef0525432e044dd18b3ae4b32d29030e` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:38.785397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a34682-118f-4214-b9e8-e0d5596f16dc None admin] RBAC: Authorizing `identity:create_grant(project_id=9bbb5023e47c45f49813194c41890827, user_id=e80900aed4204d569a981d6b2e257d13, role_id=ef0525432e044dd18b3ae4b32d29030e)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:38.787496 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a34682-118f-4214-b9e8-e0d5596f16dc None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:38.789210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd9575-49db-4190-83f1-149a73886697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:38.789922 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd9575-49db-4190-83f1-149a73886697 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:38.790280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd9575-49db-4190-83f1-149a73886697 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:38.790800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd9575-49db-4190-83f1-149a73886697 None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:38.792428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd9575-49db-4190-83f1-149a73886697 None admin] RBAC: Authorizing `identity:get_project(project_id=9bbb5023e47c45f49813194c41890827)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:38.794972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd9575-49db-4190-83f1-149a73886697 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:38.797313 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 66/131] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:38 2022] GET /identity/v3/projects/9bbb5023e47c45f49813194c41890827 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:38.798007 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd9575-49db-4190-83f1-149a73886697 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:38.805230 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 66/132] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:17:38 2022] PUT /identity/v3/projects/9bbb5023e47c45f49813194c41890827/users/e80900aed4204d569a981d6b2e257d13/roles/ef0525432e044dd18b3ae4b32d29030e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:17:38.806456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a34682-118f-4214-b9e8-e0d5596f16dc None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:38.924219 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd9575-49db-4190-83f1-149a73886697 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:38.939890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a34682-118f-4214-b9e8-e0d5596f16dc None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:38.980261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d73b9-9e7c-4f77-ad3a-7afd992e66be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:38.982752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d73b9-9e7c-4f77-ad3a-7afd992e66be None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:38.984799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d73b9-9e7c-4f77-ad3a-7afd992e66be None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:38.985525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d73b9-9e7c-4f77-ad3a-7afd992e66be None admin] PATH_INFO: `/v3/users/a348fc63930b48c2bf96319b964824d3` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:38.988391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d73b9-9e7c-4f77-ad3a-7afd992e66be None admin] RBAC: Authorizing `identity:get_user(user_id=a348fc63930b48c2bf96319b964824d3)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:38.991222 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d73b9-9e7c-4f77-ad3a-7afd992e66be None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:38.998125 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 67/133] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:38 2022] GET /identity/v3/users/a348fc63930b48c2bf96319b964824d3 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:38.999279 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d73b9-9e7c-4f77-ad3a-7afd992e66be None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:39.001032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56055cf-6b72-4f59-a829-237c537ecd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:39.004305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56055cf-6b72-4f59-a829-237c537ecd3a None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:39.004793 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56055cf-6b72-4f59-a829-237c537ecd3a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:39.005266 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56055cf-6b72-4f59-a829-237c537ecd3a None admin] PATH_INFO: `/v3/projects/c89e1d4dcb894ce2a06be56a6d91c3e6/users/e80900aed4204d569a981d6b2e257d13/roles/ef0525432e044dd18b3ae4b32d29030e` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:39.008700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56055cf-6b72-4f59-a829-237c537ecd3a None admin] RBAC: Authorizing `identity:create_grant(project_id=c89e1d4dcb894ce2a06be56a6d91c3e6, user_id=e80900aed4204d569a981d6b2e257d13, role_id=ef0525432e044dd18b3ae4b32d29030e)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:39.016447 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56055cf-6b72-4f59-a829-237c537ecd3a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:39.031581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:39.045020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 67/134] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:17:38 2022] PUT /identity/v3/projects/c89e1d4dcb894ce2a06be56a6d91c3e6/users/e80900aed4204d569a981d6b2e257d13/roles/ef0525432e044dd18b3ae4b32d29030e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:17:39.046543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56055cf-6b72-4f59-a829-237c537ecd3a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:39.079881 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:39.191372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d73b9-9e7c-4f77-ad3a-7afd992e66be None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:39.272263 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40843390-412d-4d83-9228-4779ff3a78a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:39.273036 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40843390-412d-4d83-9228-4779ff3a78a4 None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:39.273321 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40843390-412d-4d83-9228-4779ff3a78a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:39.273862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40843390-412d-4d83-9228-4779ff3a78a4 None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827/users/e80900aed4204d569a981d6b2e257d13/roles/655c93c88bc34badbfd2aad45491a96b` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:39.282124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40843390-412d-4d83-9228-4779ff3a78a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=9bbb5023e47c45f49813194c41890827, user_id=e80900aed4204d569a981d6b2e257d13, role_id=655c93c88bc34badbfd2aad45491a96b)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:39.284619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40843390-412d-4d83-9228-4779ff3a78a4 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:39.300031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56055cf-6b72-4f59-a829-237c537ecd3a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:39.316930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 68/135] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:17:38 2022] PUT /identity/v3/projects/9bbb5023e47c45f49813194c41890827/users/e80900aed4204d569a981d6b2e257d13/roles/655c93c88bc34badbfd2aad45491a96b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:17:39.350077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9781e9-f1bd-4861-ab1f-bdf17e5b3178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:39.350749 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9781e9-f1bd-4861-ab1f-bdf17e5b3178 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:39.351066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9781e9-f1bd-4861-ab1f-bdf17e5b3178 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:39.351403 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9781e9-f1bd-4861-ab1f-bdf17e5b3178 None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:39.352674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9781e9-f1bd-4861-ab1f-bdf17e5b3178 None admin] RBAC: Authorizing `identity:get_project(project_id=9bbb5023e47c45f49813194c41890827)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:39.354499 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9781e9-f1bd-4861-ab1f-bdf17e5b3178 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:39.356605 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 68/136] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:39 2022] GET /identity/v3/projects/9bbb5023e47c45f49813194c41890827 => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:39.362955 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40843390-412d-4d83-9228-4779ff3a78a4 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:39.446092 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f077c80-c878-4d11-bb2b-ab432e24d1e9 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:39.446515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f077c80-c878-4d11-bb2b-ab432e24d1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:39.446796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f077c80-c878-4d11-bb2b-ab432e24d1e9 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:39.448726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 69/137] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:39.456958 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:39.460801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc88e58-ddb5-4788-875f-0ab56001f048 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:39.461397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc88e58-ddb5-4788-875f-0ab56001f048 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:39.462032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc88e58-ddb5-4788-875f-0ab56001f048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:39.507690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-5bc88e58-ddb5-4788-875f-0ab56001f048 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:39.509332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5bc88e58-ddb5-4788-875f-0ab56001f048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:39.511494 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40843390-412d-4d83-9228-4779ff3a78a4 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:39.584214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c80eb-fe39-46f7-b0d5-b6496957c48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:39.585150 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c80eb-fe39-46f7-b0d5-b6496957c48b None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:39.585997 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c80eb-fe39-46f7-b0d5-b6496957c48b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:39.587027 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c80eb-fe39-46f7-b0d5-b6496957c48b None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827/users/a348fc63930b48c2bf96319b964824d3/roles/dd27845a836a4f6ebece149dbebc59c0` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:39.591097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c80eb-fe39-46f7-b0d5-b6496957c48b None admin] RBAC: Authorizing `identity:create_grant(project_id=9bbb5023e47c45f49813194c41890827, user_id=a348fc63930b48c2bf96319b964824d3, role_id=dd27845a836a4f6ebece149dbebc59c0)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:39.598975 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c80eb-fe39-46f7-b0d5-b6496957c48b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:39.622268 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 69/138] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:17:39 2022] PUT /identity/v3/projects/9bbb5023e47c45f49813194c41890827/users/a348fc63930b48c2bf96319b964824d3/roles/dd27845a836a4f6ebece149dbebc59c0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:17:39.659815 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 70/139] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:17:39.900398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba25aa-d975-47e7-8123-ec9c36a072d6 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:39.900964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba25aa-d975-47e7-8123-ec9c36a072d6 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:39.901391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba25aa-d975-47e7-8123-ec9c36a072d6 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:39.903855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 70/140] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:39.909323 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a81669-3a42-4262-81d2-1bba9e227f3f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:39.909840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a81669-3a42-4262-81d2-1bba9e227f3f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:39.910315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a81669-3a42-4262-81d2-1bba9e227f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:39.935028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-a1a81669-3a42-4262-81d2-1bba9e227f3f None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:39.936559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a1a81669-3a42-4262-81d2-1bba9e227f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:39.940025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:40.035443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 71/141] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:40.044874 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba25aa-d975-47e7-8123-ec9c36a072d6 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:40.168844 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba25aa-d975-47e7-8123-ec9c36a072d6 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:40.218510 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac9d53-65c5-48ac-bff6-29e7be4bb36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:40.219857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac9d53-65c5-48ac-bff6-29e7be4bb36c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:40.220279 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac9d53-65c5-48ac-bff6-29e7be4bb36c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:40.220694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac9d53-65c5-48ac-bff6-29e7be4bb36c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:40.221970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac9d53-65c5-48ac-bff6-29e7be4bb36c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:40.223581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac9d53-65c5-48ac-bff6-29e7be4bb36c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:40.225285 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 71/142] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:17:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:40.231416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a81669-3a42-4262-81d2-1bba9e227f3f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:40.366303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a81669-3a42-4262-81d2-1bba9e227f3f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:40.407771 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8c23e-0462-4db6-ad08-66baa95e49ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:40.408395 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8c23e-0462-4db6-ad08-66baa95e49ec None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:40.408678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8c23e-0462-4db6-ad08-66baa95e49ec None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:40.408953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8c23e-0462-4db6-ad08-66baa95e49ec None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:40.409609 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8c23e-0462-4db6-ad08-66baa95e49ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:40.411096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8c23e-0462-4db6-ad08-66baa95e49ec None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:40.427176 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:40.441964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 72/143] 10.222.0.25 () {60 vars in 1132 bytes} [Sat Sep 24 19:17:40 2022] POST /identity/v3/users => generated 283 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:17:40.473778 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac9d53-65c5-48ac-bff6-29e7be4bb36c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:40.477934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:40.608727 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac9d53-65c5-48ac-bff6-29e7be4bb36c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:40.653817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ce5dc-2476-4834-8974-f902f51e200d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:40.654532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ce5dc-2476-4834-8974-f902f51e200d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:40.654812 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ce5dc-2476-4834-8974-f902f51e200d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:40.655107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ce5dc-2476-4834-8974-f902f51e200d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:40.670679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ce5dc-2476-4834-8974-f902f51e200d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:40.676177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-596ce5dc-2476-4834-8974-f902f51e200d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:17:40.676177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:40.676177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:40.676177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:40.676177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:40.676177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:40.676177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:40.676177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:40.676177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:40.676177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:40.676177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:40.676177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:40.676177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:40.676177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:40.676177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:40.676177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:40.677071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:40.677071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:40.677071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:40.677071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:40.677071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:40.677071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:40.677071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:40.677071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:40.677071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:40.677071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:40.677071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:40.677071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:40.677071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:40.677071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:40.677071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:40.677071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:40.677910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:40.677910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:40.677910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:40.677910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:40.677910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:40.677910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:40.677910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:40.677910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:40.677910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:40.677910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:40.677910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:17:40.677910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:17:40.677910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 72/144] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:17:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:17:40.684535 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8c23e-0462-4db6-ad08-66baa95e49ec None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:40.861679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8c23e-0462-4db6-ad08-66baa95e49ec None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:40.910791 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e28ea-a68f-4376-b018-0533c624c6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:40.911448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e28ea-a68f-4376-b018-0533c624c6da None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:40.911728 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e28ea-a68f-4376-b018-0533c624c6da None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:40.912001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e28ea-a68f-4376-b018-0533c624c6da None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:40.912673 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e28ea-a68f-4376-b018-0533c624c6da None admin] RBAC: Adding query filter params (name=reader) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:40.912972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e28ea-a68f-4376-b018-0533c624c6da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:40.914351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e28ea-a68f-4376-b018-0533c624c6da None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:40.927812 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 73/145] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:17:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:40.933228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ce5dc-2476-4834-8974-f902f51e200d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:41.016179 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:41.064635 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ce5dc-2476-4834-8974-f902f51e200d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:41.103248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a9cf2-910f-4ff1-b9db-aa6891b89e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:41.104217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a9cf2-910f-4ff1-b9db-aa6891b89e53 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:41.104704 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a9cf2-910f-4ff1-b9db-aa6891b89e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:41.105187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a9cf2-910f-4ff1-b9db-aa6891b89e53 None admin] PATH_INFO: `/v3/users/09008a3af37a418cab1a930f2af79f83` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:41.107616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a9cf2-910f-4ff1-b9db-aa6891b89e53 None admin] RBAC: Authorizing `identity:get_user(user_id=09008a3af37a418cab1a930f2af79f83)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:41.109363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a9cf2-910f-4ff1-b9db-aa6891b89e53 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:41.111163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 73/146] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:40 2022] GET /identity/v3/users/09008a3af37a418cab1a930f2af79f83 => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:41.116986 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e28ea-a68f-4376-b018-0533c624c6da None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:41.205181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:41.264191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e28ea-a68f-4376-b018-0533c624c6da None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:41.322533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32531d12-bcc5-4aab-abe8-4e0b00d8c397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:41.323218 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32531d12-bcc5-4aab-abe8-4e0b00d8c397 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:41.323498 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32531d12-bcc5-4aab-abe8-4e0b00d8c397 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:41.323766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32531d12-bcc5-4aab-abe8-4e0b00d8c397 None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:41.331634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32531d12-bcc5-4aab-abe8-4e0b00d8c397 None admin] RBAC: Authorizing `identity:get_project(project_id=9bbb5023e47c45f49813194c41890827)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:41.333106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32531d12-bcc5-4aab-abe8-4e0b00d8c397 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:41.335190 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 74/147] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:41 2022] GET /identity/v3/projects/9bbb5023e47c45f49813194c41890827 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:41.341056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a9cf2-910f-4ff1-b9db-aa6891b89e53 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:41.478800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a9cf2-910f-4ff1-b9db-aa6891b89e53 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:41.515628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:41.521334 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38d597-da66-48d2-ab20-9febef946768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:41.522112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d597-da66-48d2-ab20-9febef946768 None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:41.522394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d597-da66-48d2-ab20-9febef946768 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:41.522665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d597-da66-48d2-ab20-9febef946768 None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827/users/09008a3af37a418cab1a930f2af79f83/roles/4b618f407f654e32a6a29da3aa4f83e2` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:41.528760 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38d597-da66-48d2-ab20-9febef946768 None admin] RBAC: Authorizing `identity:create_grant(project_id=9bbb5023e47c45f49813194c41890827, user_id=09008a3af37a418cab1a930f2af79f83, role_id=4b618f407f654e32a6a29da3aa4f83e2)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:41.530222 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38d597-da66-48d2-ab20-9febef946768 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:41.550637 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 74/148] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:17:41 2022] PUT /identity/v3/projects/9bbb5023e47c45f49813194c41890827/users/09008a3af37a418cab1a930f2af79f83/roles/4b618f407f654e32a6a29da3aa4f83e2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:17:41.860232 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eb90e-6725-46c1-89de-fbe634cf2650 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:41.860772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eb90e-6725-46c1-89de-fbe634cf2650 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:41.860772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eb90e-6725-46c1-89de-fbe634cf2650 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:41.862101 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 75/149] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:41.868646 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f1c91-f04f-4e8a-adef-4046afeb86cd None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:41.868937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f1c91-f04f-4e8a-adef-4046afeb86cd None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:41.869200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f1c91-f04f-4e8a-adef-4046afeb86cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:41.893239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-b40f1c91-f04f-4e8a-adef-4046afeb86cd None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:41.894557 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b40f1c91-f04f-4e8a-adef-4046afeb86cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:41.972190 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 75/150] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:42.507579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93eb90e-6725-46c1-89de-fbe634cf2650 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:42.632547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93eb90e-6725-46c1-89de-fbe634cf2650 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:42.662256 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:42.677427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff8243-2659-4f46-9894-12575e7fc91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:42.677997 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff8243-2659-4f46-9894-12575e7fc91d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:42.678275 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff8243-2659-4f46-9894-12575e7fc91d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:42.678545 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff8243-2659-4f46-9894-12575e7fc91d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:42.692002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff8243-2659-4f46-9894-12575e7fc91d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:42.697088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-6eff8243-2659-4f46-9894-12575e7fc91d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:17:42.697088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:42.697088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:42.697088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:42.697088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:42.697088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:42.697088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:42.697088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:42.697088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:42.697088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:42.697088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:42.697088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:42.697088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:42.697088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:42.697088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:42.697088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:42.698000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:42.698000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:42.698000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:42.698000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:42.698000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:42.698000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:42.698000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:42.698000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:42.698000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:42.698000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:42.698000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:42.698000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:42.698000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:42.698000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:42.698000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:42.698000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:42.698795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:42.698795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:42.698795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:42.698795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:42.698795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:42.698795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:42.698795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:42.698795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:42.698795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:42.698795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:42.698795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:17:42.698795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:17:42.698795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 76/151] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:17:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:42.704790 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f1c91-f04f-4e8a-adef-4046afeb86cd None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:42.852331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f1c91-f04f-4e8a-adef-4046afeb86cd None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:42.881584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:42.901214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bf9af-612f-47b4-9191-87ec40abc552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:42.901832 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bf9af-612f-47b4-9191-87ec40abc552 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:42.902693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bf9af-612f-47b4-9191-87ec40abc552 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:42.903108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bf9af-612f-47b4-9191-87ec40abc552 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:42.904029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bf9af-612f-47b4-9191-87ec40abc552 None admin] RBAC: Adding query filter params (name=member) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:42.904329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bf9af-612f-47b4-9191-87ec40abc552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:42.905803 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bf9af-612f-47b4-9191-87ec40abc552 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:42.914644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 76/152] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:17:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:42.921003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff8243-2659-4f46-9894-12575e7fc91d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:42.964528 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dfa07-60ac-4db7-83e2-80bc0ac9ee93 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:42.965723 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dfa07-60ac-4db7-83e2-80bc0ac9ee93 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:42.966177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dfa07-60ac-4db7-83e2-80bc0ac9ee93 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:42.968012 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 77/153] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:42.984667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b382a5-f57b-4b7d-b71b-32c69a20b940 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:42.985235 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b382a5-f57b-4b7d-b71b-32c69a20b940 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:42.985763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b382a5-f57b-4b7d-b71b-32c69a20b940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:43.014086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-38b382a5-f57b-4b7d-b71b-32c69a20b940 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:43.015602 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-38b382a5-f57b-4b7d-b71b-32c69a20b940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:43.044854 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff8243-2659-4f46-9894-12575e7fc91d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:43.086044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a469f89-fc27-4184-8fb7-ec78616b441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:43.086689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469f89-fc27-4184-8fb7-ec78616b441f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:43.087018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469f89-fc27-4184-8fb7-ec78616b441f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:43.087296 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469f89-fc27-4184-8fb7-ec78616b441f None admin] PATH_INFO: `/v3/users/e80900aed4204d569a981d6b2e257d13` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:43.088453 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a469f89-fc27-4184-8fb7-ec78616b441f None admin] RBAC: Authorizing `identity:get_user(user_id=e80900aed4204d569a981d6b2e257d13)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:43.090608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a469f89-fc27-4184-8fb7-ec78616b441f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:43.092518 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 77/154] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:42 2022] GET /identity/v3/users/e80900aed4204d569a981d6b2e257d13 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:43.093483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3c439-6869-4020-829e-05abdeb24a31 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:43.093764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3c439-6869-4020-829e-05abdeb24a31 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:43.094033 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3c439-6869-4020-829e-05abdeb24a31 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:43.099598 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 78/155] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:43.102524 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3c439-6869-4020-829e-05abdeb24a31 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:43.126401 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 78/156] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:43.128609 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf7f61-3ac5-4398-acfa-4f15a12b2356 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:43.129090 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf7f61-3ac5-4398-acfa-4f15a12b2356 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:43.129574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf7f61-3ac5-4398-acfa-4f15a12b2356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:43.161374 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-36cf7f61-3ac5-4398-acfa-4f15a12b2356 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:43.164171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-36cf7f61-3ac5-4398-acfa-4f15a12b2356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:43.221817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:43.277169 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 79/157] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:43.282959 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b55738-1282-4301-9fed-8b0a5b98858f None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:43.283531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b55738-1282-4301-9fed-8b0a5b98858f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:43.284002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b55738-1282-4301-9fed-8b0a5b98858f None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:43.285996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 80/158] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:43.291121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e6306-ceec-4372-9d74-3e09fec3021d None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:43.291641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3c439-6869-4020-829e-05abdeb24a31 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:43.291785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e6306-ceec-4372-9d74-3e09fec3021d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:43.292322 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e6306-ceec-4372-9d74-3e09fec3021d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:43.322107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-2f3e6306-ceec-4372-9d74-3e09fec3021d None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:43.323671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2f3e6306-ceec-4372-9d74-3e09fec3021d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:43.344519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f4af8-c01c-4b15-ad65-3d2c713f742a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:43.345161 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f4af8-c01c-4b15-ad65-3d2c713f742a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:43.345418 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f4af8-c01c-4b15-ad65-3d2c713f742a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:43.345692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f4af8-c01c-4b15-ad65-3d2c713f742a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:43.381965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:43.436615 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 81/159] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:43.440074 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f4af8-c01c-4b15-ad65-3d2c713f742a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:43.441544 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f4af8-c01c-4b15-ad65-3d2c713f742a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:43.497013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:43.545728 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 79/160] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:17:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:17:43.551373 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e6306-ceec-4372-9d74-3e09fec3021d None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:43.698182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e6306-ceec-4372-9d74-3e09fec3021d None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:43.742473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53462e42-08d1-428d-939e-1d5af9400b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:43.743952 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53462e42-08d1-428d-939e-1d5af9400b8c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:43.744442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53462e42-08d1-428d-939e-1d5af9400b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:43.744911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53462e42-08d1-428d-939e-1d5af9400b8c None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:43.746821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53462e42-08d1-428d-939e-1d5af9400b8c None admin] RBAC: Authorizing `identity:get_project(project_id=9bbb5023e47c45f49813194c41890827)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:43.748724 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53462e42-08d1-428d-939e-1d5af9400b8c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:43.750872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 82/161] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:43 2022] GET /identity/v3/projects/9bbb5023e47c45f49813194c41890827 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:43.756530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f4af8-c01c-4b15-ad65-3d2c713f742a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:43.833826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53462e42-08d1-428d-939e-1d5af9400b8c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:43.876964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f4af8-c01c-4b15-ad65-3d2c713f742a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:43.900651 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:43.913669 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cfb59-f349-49a0-8aed-73c1bb54f062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:43.914289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cfb59-f349-49a0-8aed-73c1bb54f062 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:43.914571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cfb59-f349-49a0-8aed-73c1bb54f062 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:43.914856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cfb59-f349-49a0-8aed-73c1bb54f062 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:43.915591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cfb59-f349-49a0-8aed-73c1bb54f062 None admin] RBAC: Adding query filter params (role.id=ef0525432e044dd18b3ae4b32d29030e, scope.project.id=9bbb5023e47c45f49813194c41890827, user.id=e80900aed4204d569a981d6b2e257d13) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:43.915899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cfb59-f349-49a0-8aed-73c1bb54f062 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:43.917327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cfb59-f349-49a0-8aed-73c1bb54f062 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:43.923907 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 80/162] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:17:43 2022] GET /identity/v3/role_assignments?user.id=e80900aed4204d569a981d6b2e257d13&scope.project.id=9bbb5023e47c45f49813194c41890827&role.id=ef0525432e044dd18b3ae4b32d29030e => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:43.924726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cfb59-f349-49a0-8aed-73c1bb54f062 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:43.955525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:44.007966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53462e42-08d1-428d-939e-1d5af9400b8c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:44.051491 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cfb59-f349-49a0-8aed-73c1bb54f062 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:44.079621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378df4a6-f0ea-4473-b97f-addafcab6858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:44.080707 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378df4a6-f0ea-4473-b97f-addafcab6858 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:44.081178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378df4a6-f0ea-4473-b97f-addafcab6858 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:44.081661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378df4a6-f0ea-4473-b97f-addafcab6858 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:44.101577 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378df4a6-f0ea-4473-b97f-addafcab6858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:44.103108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e202d0-18b8-4933-b674-e4ec597a060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:44.103768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e202d0-18b8-4933-b674-e4ec597a060b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:44.104048 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e202d0-18b8-4933-b674-e4ec597a060b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:44.104318 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e202d0-18b8-4933-b674-e4ec597a060b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:44.109912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-378df4a6-f0ea-4473-b97f-addafcab6858 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:17:44.109912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:44.109912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:44.109912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:44.109912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:44.109912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:44.109912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:44.109912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:44.109912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:44.109912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:44.109912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:44.109912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:44.109912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:44.109912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:44.109912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:44.109912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:44.110864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:44.110864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:44.110864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:44.110864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:44.110864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:44.110864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:44.110864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:44.110864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:44.110864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:44.110864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:44.110864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:44.110864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:44.110864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:44.110864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:44.110864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:44.110864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:44.111739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:44.111739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:44.111739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:44.111739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:44.111739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:44.111739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:44.111739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:44.111739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:44.111739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:44.111739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:44.111739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:17:44.111739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:17:44.114545 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 83/163] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:17:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:44.119770 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378df4a6-f0ea-4473-b97f-addafcab6858 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:44.122615 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e202d0-18b8-4933-b674-e4ec597a060b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:44.128111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-09e202d0-18b8-4933-b674-e4ec597a060b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:17:44.128111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:44.128111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:44.128111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:44.128111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:44.128111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:44.128111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:44.128111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:44.128111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:44.128111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:44.128111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:44.128111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:44.128111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:44.128111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:44.128111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:44.128111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:44.129108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:44.129108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:44.129108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:44.129108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:44.129108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:44.129108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:44.129108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:44.129108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:44.129108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:44.129108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:44.129108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:44.129108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:44.129108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:44.129108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:44.129108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:44.129108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:44.129879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:44.129879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:44.129879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:44.129879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:44.129879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:44.129879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:44.129879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:44.129879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:44.129879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:44.129879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:44.129879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:17:44.129879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:17:44.129879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 81/164] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:17:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:44.130517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e202d0-18b8-4933-b674-e4ec597a060b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:44.260801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:44.278303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:44.284640 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378df4a6-f0ea-4473-b97f-addafcab6858 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:44.295652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e202d0-18b8-4933-b674-e4ec597a060b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:44.349336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d60ad-8e85-4d68-9300-661698164483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:44.349962 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d60ad-8e85-4d68-9300-661698164483 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:44.350251 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d60ad-8e85-4d68-9300-661698164483 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:44.350524 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d60ad-8e85-4d68-9300-661698164483 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:44.354170 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d60ad-8e85-4d68-9300-661698164483 None admin] RBAC: Adding query filter params (name=member) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:44.354170 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d60ad-8e85-4d68-9300-661698164483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:44.354170 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d60ad-8e85-4d68-9300-661698164483 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:44.356185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066d9cf-de03-4da9-a259-a66b1121ab63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:44.357279 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066d9cf-de03-4da9-a259-a66b1121ab63 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:44.357768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066d9cf-de03-4da9-a259-a66b1121ab63 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:44.358227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066d9cf-de03-4da9-a259-a66b1121ab63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:44.366974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 82/165] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:17:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:44.367855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d60ad-8e85-4d68-9300-661698164483 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:44.378152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066d9cf-de03-4da9-a259-a66b1121ab63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:44.384022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-a066d9cf-de03-4da9-a259-a66b1121ab63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:17:44.384022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:44.384022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:44.384022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:44.384022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:44.384022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:44.384022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:44.384022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:44.384022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:44.384022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:44.384022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:44.384022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:44.384022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:44.384022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:44.384022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:44.384022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:44.384914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:44.384914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:44.384914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:44.384914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:44.384914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:44.384914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:44.384914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:44.384914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:44.384914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:44.384914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:44.384914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:44.384914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:44.384914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:44.384914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:44.384914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:44.384914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:44.385735 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:44.385735 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:44.385735 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:44.385735 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:44.385735 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:44.385735 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:44.385735 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:44.385735 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:44.385735 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:44.385735 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:44.385735 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:17:44.385735 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:17:44.388497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 84/166] 10.222.0.25 () {56 vars in 1114 bytes} [Sat Sep 24 19:17:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:44.393919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066d9cf-de03-4da9-a259-a66b1121ab63 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:44.476917 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d60ad-8e85-4d68-9300-661698164483 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:44.517887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea2b5c-6fc6-45c4-861c-f0dfc0c9a787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:44.518431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea2b5c-6fc6-45c4-861c-f0dfc0c9a787 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:44.518712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea2b5c-6fc6-45c4-861c-f0dfc0c9a787 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:44.519027 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea2b5c-6fc6-45c4-861c-f0dfc0c9a787 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:44.519693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea2b5c-6fc6-45c4-861c-f0dfc0c9a787 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:44.520549 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea2b5c-6fc6-45c4-861c-f0dfc0c9a787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:44.521964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea2b5c-6fc6-45c4-861c-f0dfc0c9a787 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:44.534145 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 83/167] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:17:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:44.534808 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea2b5c-6fc6-45c4-861c-f0dfc0c9a787 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:44.538442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:44.602555 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066d9cf-de03-4da9-a259-a66b1121ab63 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:44.660318 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb828d5-bfd1-496d-b5f4-74186f5bcab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:44.660960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb828d5-bfd1-496d-b5f4-74186f5bcab1 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:44.661239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb828d5-bfd1-496d-b5f4-74186f5bcab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:44.661563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb828d5-bfd1-496d-b5f4-74186f5bcab1 None admin] PATH_INFO: `/v3/users/e80900aed4204d569a981d6b2e257d13` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:44.662868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb828d5-bfd1-496d-b5f4-74186f5bcab1 None admin] RBAC: Authorizing `identity:get_user(user_id=e80900aed4204d569a981d6b2e257d13)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:44.665533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb828d5-bfd1-496d-b5f4-74186f5bcab1 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:44.667144 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 85/168] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:44 2022] GET /identity/v3/users/e80900aed4204d569a981d6b2e257d13 => generated 275 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:44.668009 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb828d5-bfd1-496d-b5f4-74186f5bcab1 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:44.697043 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea2b5c-6fc6-45c4-861c-f0dfc0c9a787 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:44.725018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:44.757954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e867a33-131b-41ba-8cb3-a95184810da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:44.758567 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e867a33-131b-41ba-8cb3-a95184810da6 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:44.758859 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e867a33-131b-41ba-8cb3-a95184810da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:44.759135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e867a33-131b-41ba-8cb3-a95184810da6 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:44.759796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e867a33-131b-41ba-8cb3-a95184810da6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:44.760096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e867a33-131b-41ba-8cb3-a95184810da6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:44.762092 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e867a33-131b-41ba-8cb3-a95184810da6 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:44.774560 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 84/169] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:17:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:44.779006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e867a33-131b-41ba-8cb3-a95184810da6 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:44.860450 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb828d5-bfd1-496d-b5f4-74186f5bcab1 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:44.899209 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:44.936948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004159eb-8fc3-410b-9e54-b370d5ef38c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:44.937601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004159eb-8fc3-410b-9e54-b370d5ef38c5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:44.937880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004159eb-8fc3-410b-9e54-b370d5ef38c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:44.938147 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004159eb-8fc3-410b-9e54-b370d5ef38c5 None admin] PATH_INFO: `/v3/users/a348fc63930b48c2bf96319b964824d3` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:44.939487 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004159eb-8fc3-410b-9e54-b370d5ef38c5 None admin] RBAC: Authorizing `identity:get_user(user_id=a348fc63930b48c2bf96319b964824d3)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:44.940931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004159eb-8fc3-410b-9e54-b370d5ef38c5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:44.941865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e867a33-131b-41ba-8cb3-a95184810da6 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:44.942528 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 86/170] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:44 2022] GET /identity/v3/users/a348fc63930b48c2bf96319b964824d3 => generated 247 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:44.947722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004159eb-8fc3-410b-9e54-b370d5ef38c5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:44.983367 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f157c-ed68-478e-8208-334871f4a807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:44.983981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f157c-ed68-478e-8208-334871f4a807 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:44.984269 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f157c-ed68-478e-8208-334871f4a807 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:44.984533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f157c-ed68-478e-8208-334871f4a807 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:45.065658 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f157c-ed68-478e-8208-334871f4a807 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:45.067160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f157c-ed68-478e-8208-334871f4a807 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:45.132597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:45.138999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004159eb-8fc3-410b-9e54-b370d5ef38c5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:45.139232 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:45.180154 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 85/171] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:17:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:17:45.181346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f157c-ed68-478e-8208-334871f4a807 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:45.235566 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2af1c-cd10-4c68-8430-4f3ff2c40108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:45.236221 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2af1c-cd10-4c68-8430-4f3ff2c40108 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:45.236500 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2af1c-cd10-4c68-8430-4f3ff2c40108 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:45.236774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2af1c-cd10-4c68-8430-4f3ff2c40108 None admin] PATH_INFO: `/v3/users/e80900aed4204d569a981d6b2e257d13` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:45.237975 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2af1c-cd10-4c68-8430-4f3ff2c40108 None admin] RBAC: Authorizing `identity:get_user(user_id=e80900aed4204d569a981d6b2e257d13)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:45.239460 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2af1c-cd10-4c68-8430-4f3ff2c40108 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:45.241037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 87/172] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:44 2022] GET /identity/v3/users/e80900aed4204d569a981d6b2e257d13 => generated 275 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:45.247288 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2af1c-cd10-4c68-8430-4f3ff2c40108 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:45.295065 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f157c-ed68-478e-8208-334871f4a807 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:45.333442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe3ac0-a586-4f7d-8048-9e7768cae2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:45.334426 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe3ac0-a586-4f7d-8048-9e7768cae2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:45.334953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe3ac0-a586-4f7d-8048-9e7768cae2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:45.335444 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe3ac0-a586-4f7d-8048-9e7768cae2c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:45.383182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:45.428658 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe3ac0-a586-4f7d-8048-9e7768cae2c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:45.430389 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe3ac0-a586-4f7d-8048-9e7768cae2c7 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:45.477613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2af1c-cd10-4c68-8430-4f3ff2c40108 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:45.524477 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6866085-5e1e-449a-aba8-3248e8084559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:45.525112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6866085-5e1e-449a-aba8-3248e8084559 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:45.525391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6866085-5e1e-449a-aba8-3248e8084559 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:45.525662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6866085-5e1e-449a-aba8-3248e8084559 None admin] PATH_INFO: `/v3/projects/c89e1d4dcb894ce2a06be56a6d91c3e6` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:45.526946 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6866085-5e1e-449a-aba8-3248e8084559 None admin] RBAC: Authorizing `identity:get_project(project_id=c89e1d4dcb894ce2a06be56a6d91c3e6)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:45.528584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6866085-5e1e-449a-aba8-3248e8084559 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:45.535380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 88/173] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:45 2022] GET /identity/v3/projects/c89e1d4dcb894ce2a06be56a6d91c3e6 => generated 312 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:45.536244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6866085-5e1e-449a-aba8-3248e8084559 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:45.537622 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 86/174] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:17:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:17:45.539120 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0692b-2d80-4694-9e27-8c9513dc80dd None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:45.539603 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0692b-2d80-4694-9e27-8c9513dc80dd None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:45.540087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0692b-2d80-4694-9e27-8c9513dc80dd None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:45.541515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 87/175] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:45.548958 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f0cae-b866-42e2-bb29-bb36a2f44e00 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:45.549789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f0cae-b866-42e2-bb29-bb36a2f44e00 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:45.550560 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f0cae-b866-42e2-bb29-bb36a2f44e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:45.609038 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-842f0cae-b866-42e2-bb29-bb36a2f44e00 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:45.611565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-842f0cae-b866-42e2-bb29-bb36a2f44e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:45.655218 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:45.734284 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:45.748384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 88/176] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:45.750198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f0cae-b866-42e2-bb29-bb36a2f44e00 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:45.778729 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6866085-5e1e-449a-aba8-3248e8084559 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:45.840116 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc8f01-7c49-4938-b4f3-8165de366a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:45.841112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc8f01-7c49-4938-b4f3-8165de366a33 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:45.841590 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc8f01-7c49-4938-b4f3-8165de366a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:45.842056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc8f01-7c49-4938-b4f3-8165de366a33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:45.963321 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc8f01-7c49-4938-b4f3-8165de366a33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:45.966730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc8f01-7c49-4938-b4f3-8165de366a33 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:46.027736 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:46.036775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f0cae-b866-42e2-bb29-bb36a2f44e00 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:46.100351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f769bff-5952-4b7f-9137-a53cff55b91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:46.100983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f769bff-5952-4b7f-9137-a53cff55b91f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:46.101255 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f769bff-5952-4b7f-9137-a53cff55b91f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:46.101578 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f769bff-5952-4b7f-9137-a53cff55b91f None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:46.105319 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f769bff-5952-4b7f-9137-a53cff55b91f None admin] RBAC: Authorizing `identity:get_project(project_id=9bbb5023e47c45f49813194c41890827)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:46.107128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f769bff-5952-4b7f-9137-a53cff55b91f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:46.109140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 89/177] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:45 2022] GET /identity/v3/projects/9bbb5023e47c45f49813194c41890827 => generated 298 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:46.109900 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f769bff-5952-4b7f-9137-a53cff55b91f None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:46.150291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 89/178] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:17:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:17:46.153640 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac2675-5b23-44bd-954b-6003f56ca49e None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:46.154128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac2675-5b23-44bd-954b-6003f56ca49e None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:46.154601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac2675-5b23-44bd-954b-6003f56ca49e None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:46.157073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 90/179] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:46.158386 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac2675-5b23-44bd-954b-6003f56ca49e None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:46.255598 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:46.316322 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f769bff-5952-4b7f-9137-a53cff55b91f None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:46.327618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac2675-5b23-44bd-954b-6003f56ca49e None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:46.353926 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ba410-3b6c-4ba8-8b86-f484c6f41cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:46.354545 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ba410-3b6c-4ba8-8b86-f484c6f41cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:46.354852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ba410-3b6c-4ba8-8b86-f484c6f41cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:46.355661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ba410-3b6c-4ba8-8b86-f484c6f41cb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:46.356726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ba410-3b6c-4ba8-8b86-f484c6f41cb9 None admin] RBAC: Adding query filter params (role.id=ef0525432e044dd18b3ae4b32d29030e, scope.project.id=c89e1d4dcb894ce2a06be56a6d91c3e6, user.id=e80900aed4204d569a981d6b2e257d13) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:46.357038 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ba410-3b6c-4ba8-8b86-f484c6f41cb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:46.358886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ba410-3b6c-4ba8-8b86-f484c6f41cb9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:46.361148 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:46.365086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 90/180] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:17:46 2022] GET /identity/v3/role_assignments?user.id=e80900aed4204d569a981d6b2e257d13&scope.project.id=c89e1d4dcb894ce2a06be56a6d91c3e6&role.id=ef0525432e044dd18b3ae4b32d29030e => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:46.365880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ba410-3b6c-4ba8-8b86-f484c6f41cb9 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:46.373393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e01930-7a6c-4714-bd3f-8095d593d105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:46.374282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e01930-7a6c-4714-bd3f-8095d593d105 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:46.374744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e01930-7a6c-4714-bd3f-8095d593d105 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:46.375200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e01930-7a6c-4714-bd3f-8095d593d105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:46.376962 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e01930-7a6c-4714-bd3f-8095d593d105 None admin] RBAC: Adding query filter params (role.id=dd27845a836a4f6ebece149dbebc59c0, scope.project.id=9bbb5023e47c45f49813194c41890827, user.id=a348fc63930b48c2bf96319b964824d3) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:46.377449 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e01930-7a6c-4714-bd3f-8095d593d105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:46.379860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e01930-7a6c-4714-bd3f-8095d593d105 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:46.389658 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 91/181] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:17:46 2022] GET /identity/v3/role_assignments?user.id=a348fc63930b48c2bf96319b964824d3&scope.project.id=9bbb5023e47c45f49813194c41890827&role.id=dd27845a836a4f6ebece149dbebc59c0 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:46.391312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1add5e-5b8b-4eaa-aa7b-4767a32a331a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:46.391743 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1add5e-5b8b-4eaa-aa7b-4767a32a331a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:46.392183 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1add5e-5b8b-4eaa-aa7b-4767a32a331a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:46.414995 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-bf1add5e-5b8b-4eaa-aa7b-4767a32a331a None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:46.416844 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-bf1add5e-5b8b-4eaa-aa7b-4767a32a331a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:46.513049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 92/182] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:46.514360 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1add5e-5b8b-4eaa-aa7b-4767a32a331a None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:46.619692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ba410-3b6c-4ba8-8b86-f484c6f41cb9 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:46.645888 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1add5e-5b8b-4eaa-aa7b-4767a32a331a None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:46.651706 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:46.663363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909c5dc-65d9-41ce-aa86-96ff529f0fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:46.664164 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909c5dc-65d9-41ce-aa86-96ff529f0fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:46.664548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909c5dc-65d9-41ce-aa86-96ff529f0fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:46.665036 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909c5dc-65d9-41ce-aa86-96ff529f0fd1 None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:46.666372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909c5dc-65d9-41ce-aa86-96ff529f0fd1 None admin] RBAC: Authorizing `identity:get_project(project_id=9bbb5023e47c45f49813194c41890827)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:46.668086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909c5dc-65d9-41ce-aa86-96ff529f0fd1 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:46.669998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 91/183] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:46 2022] GET /identity/v3/projects/9bbb5023e47c45f49813194c41890827 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:46.674135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea6131-6b68-4fde-a208-8bc8cfe294b2 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:46.674540 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea6131-6b68-4fde-a208-8bc8cfe294b2 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:46.674935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea6131-6b68-4fde-a208-8bc8cfe294b2 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:46.676336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 92/184] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:46.677598 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd51cd-950f-40f2-8818-0a03fa739490 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:46.678002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd51cd-950f-40f2-8818-0a03fa739490 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:46.678560 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd51cd-950f-40f2-8818-0a03fa739490 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:46.681482 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 93/185] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:46.681593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:46.682439 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ab1af-47dc-4bc7-bf43-39661168a5fd None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:46.683838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ab1af-47dc-4bc7-bf43-39661168a5fd None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:46.684438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ab1af-47dc-4bc7-bf43-39661168a5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:46.696216 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125fece-56ee-48f1-95bc-b435447c674c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:46.696864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125fece-56ee-48f1-95bc-b435447c674c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:46.697141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125fece-56ee-48f1-95bc-b435447c674c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:46.697412 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125fece-56ee-48f1-95bc-b435447c674c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:46.705457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-9d0ab1af-47dc-4bc7-bf43-39661168a5fd None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:46.707271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-9d0ab1af-47dc-4bc7-bf43-39661168a5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:46.710513 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125fece-56ee-48f1-95bc-b435447c674c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:46.716244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-7125fece-56ee-48f1-95bc-b435447c674c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:17:46.716244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:46.716244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:46.716244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:46.716244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:46.716244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:46.716244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:46.716244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:46.716244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:46.716244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:46.716244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:46.716244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:46.716244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:46.716244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:46.716244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:46.716244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:46.717181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:46.717181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:46.717181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:46.717181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:46.717181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:46.717181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:46.717181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:46.717181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:46.717181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:46.717181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:46.717181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:46.717181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:46.717181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:46.717181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:46.717181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:46.717181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:46.717968 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:46.717968 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:46.717968 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:46.717968 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:46.717968 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:46.717968 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:46.717968 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:46.717968 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:46.717968 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:46.717968 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:46.717968 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:17:46.717968 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:17:46.717968 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 93/186] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:17:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:46.718654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125fece-56ee-48f1-95bc-b435447c674c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:46.806928 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 94/187] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:46.809067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da607c38-0d1a-4a51-a123-e76e59fc91e1 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:46.809566 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da607c38-0d1a-4a51-a123-e76e59fc91e1 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:46.810033 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da607c38-0d1a-4a51-a123-e76e59fc91e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:46.828494 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-da607c38-0d1a-4a51-a123-e76e59fc91e1 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:46.830233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-da607c38-0d1a-4a51-a123-e76e59fc91e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:46.855361 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125fece-56ee-48f1-95bc-b435447c674c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:46.893009 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c5be7-52e4-456d-bae4-83a83b153961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:46.893626 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c5be7-52e4-456d-bae4-83a83b153961 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:46.893906 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c5be7-52e4-456d-bae4-83a83b153961 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:46.894182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c5be7-52e4-456d-bae4-83a83b153961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:46.894936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c5be7-52e4-456d-bae4-83a83b153961 None admin] RBAC: Adding query filter params (role.id=655c93c88bc34badbfd2aad45491a96b, scope.project.id=9bbb5023e47c45f49813194c41890827, user.id=e80900aed4204d569a981d6b2e257d13) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:46.895246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c5be7-52e4-456d-bae4-83a83b153961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:46.896700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c5be7-52e4-456d-bae4-83a83b153961 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:46.904049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 94/188] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:17:46 2022] GET /identity/v3/role_assignments?user.id=e80900aed4204d569a981d6b2e257d13&scope.project.id=9bbb5023e47c45f49813194c41890827&role.id=655c93c88bc34badbfd2aad45491a96b => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:46.904680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c5be7-52e4-456d-bae4-83a83b153961 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:46.915318 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 95/189] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:46.920154 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da607c38-0d1a-4a51-a123-e76e59fc91e1 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:46.999215 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:47.031623 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:47.097908 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c5be7-52e4-456d-bae4-83a83b153961 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:47.113047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da607c38-0d1a-4a51-a123-e76e59fc91e1 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:47.139790 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe6e6e-9287-4df3-8bf4-a1e50813c4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:47.140411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe6e6e-9287-4df3-8bf4-a1e50813c4bf None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:47.140976 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe6e6e-9287-4df3-8bf4-a1e50813c4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:47.141260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe6e6e-9287-4df3-8bf4-a1e50813c4bf None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:47.142097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe6e6e-9287-4df3-8bf4-a1e50813c4bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:47.142411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe6e6e-9287-4df3-8bf4-a1e50813c4bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:47.144562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe6e6e-9287-4df3-8bf4-a1e50813c4bf None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:47.155969 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5202e42-771c-4925-8150-2d66e228026a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:47.156170 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 95/190] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:17:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:47.156695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5202e42-771c-4925-8150-2d66e228026a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:47.156915 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe6e6e-9287-4df3-8bf4-a1e50813c4bf None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:47.157015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5202e42-771c-4925-8150-2d66e228026a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:47.157228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5202e42-771c-4925-8150-2d66e228026a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:47.172848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5202e42-771c-4925-8150-2d66e228026a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:47.178109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-b5202e42-771c-4925-8150-2d66e228026a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:17:47.178109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:47.178109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:47.178109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:47.178109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:47.178109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:47.178109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:47.178109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:47.178109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:47.178109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:47.178109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:47.178109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:47.178109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:47.178109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:47.178109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:47.178109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:47.179037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:47.179037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:47.179037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:47.179037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:47.179037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:47.179037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:47.179037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:47.179037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:47.179037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:47.179037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:47.179037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:47.179037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:47.179037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:47.179037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:47.179037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:47.179037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:47.179840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:47.179840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:47.179840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:47.179840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:47.179840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:47.179840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:47.179840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:47.179840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:47.179840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:47.179840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:47.179840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:17:47.179840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:17:47.181968 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 96/191] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:17:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:47.184460 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5202e42-771c-4925-8150-2d66e228026a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:47.276793 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe6e6e-9287-4df3-8bf4-a1e50813c4bf None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:47.290088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:47.298019 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5202e42-771c-4925-8150-2d66e228026a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:47.311233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6112531-37de-4cf3-b423-ffca7462dad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:47.311863 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6112531-37de-4cf3-b423-ffca7462dad9 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:47.312138 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6112531-37de-4cf3-b423-ffca7462dad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:47.312412 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6112531-37de-4cf3-b423-ffca7462dad9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:47.312522 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:47.322388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6112531-37de-4cf3-b423-ffca7462dad9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:47.328400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-e6112531-37de-4cf3-b423-ffca7462dad9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:17:47.328400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:47.328400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:47.328400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:47.328400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:47.328400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:47.328400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:47.328400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:47.328400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:47.328400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:47.328400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:47.328400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:47.328400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:47.328400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:47.328400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:47.328400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:47.329462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:47.329462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:47.329462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:47.329462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:47.329462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:47.329462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:47.329462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:47.329462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:47.329462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:47.329462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:47.329462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:47.329462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:47.329462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:47.329462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:47.329462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:47.329462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:47.330436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:47.330436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:47.330436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:47.330436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:47.330436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:47.330436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:47.330436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:47.330436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:47.330436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:47.330436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:47.330436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:17:47.330436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:17:47.330436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 96/192] 10.222.0.25 () {56 vars in 1114 bytes} [Sat Sep 24 19:17:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:47.330436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6112531-37de-4cf3-b423-ffca7462dad9 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:47.336029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c237a-9db9-4141-be35-d94694df3c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:47.336655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c237a-9db9-4141-be35-d94694df3c48 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:47.336935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c237a-9db9-4141-be35-d94694df3c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:47.337203 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c237a-9db9-4141-be35-d94694df3c48 None admin] PATH_INFO: `/v3/users/09008a3af37a418cab1a930f2af79f83` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:47.338352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c237a-9db9-4141-be35-d94694df3c48 None admin] RBAC: Authorizing `identity:get_user(user_id=09008a3af37a418cab1a930f2af79f83)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:47.339891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c237a-9db9-4141-be35-d94694df3c48 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:47.341563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 97/193] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:47 2022] GET /identity/v3/users/09008a3af37a418cab1a930f2af79f83 => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:47.342312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c237a-9db9-4141-be35-d94694df3c48 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:47.431425 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6112531-37de-4cf3-b423-ffca7462dad9 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:47.445326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c237a-9db9-4141-be35-d94694df3c48 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:47.466791 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d3481-1884-4dd5-9be1-f6b125b8c66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:47.467444 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d3481-1884-4dd5-9be1-f6b125b8c66c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:47.467722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d3481-1884-4dd5-9be1-f6b125b8c66c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:47.467992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d3481-1884-4dd5-9be1-f6b125b8c66c None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:47.468648 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d3481-1884-4dd5-9be1-f6b125b8c66c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:47.468950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d3481-1884-4dd5-9be1-f6b125b8c66c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:47.470319 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d3481-1884-4dd5-9be1-f6b125b8c66c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:47.478247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d066e19-6d9b-43bf-a6bd-0ec0908eecb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:47.478373 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 97/194] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:17:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:47.478777 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d066e19-6d9b-43bf-a6bd-0ec0908eecb9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:47.478890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d3481-1884-4dd5-9be1-f6b125b8c66c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:47.479086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d066e19-6d9b-43bf-a6bd-0ec0908eecb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:47.479422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d066e19-6d9b-43bf-a6bd-0ec0908eecb9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:47.481067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d066e19-6d9b-43bf-a6bd-0ec0908eecb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:47.482496 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d066e19-6d9b-43bf-a6bd-0ec0908eecb9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:47.486951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 98/195] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:17:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:47.486951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d066e19-6d9b-43bf-a6bd-0ec0908eecb9 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:47.516171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:47.535759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:47.584073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d3481-1884-4dd5-9be1-f6b125b8c66c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:47.585488 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d066e19-6d9b-43bf-a6bd-0ec0908eecb9 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:47.618282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f83e3-78f4-479d-9ac3-1d4c23870c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:47.618905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f83e3-78f4-479d-9ac3-1d4c23870c7e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:47.619184 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f83e3-78f4-479d-9ac3-1d4c23870c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:47.619453 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f83e3-78f4-479d-9ac3-1d4c23870c7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:47.619782 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60ae66-cab8-4f5a-a976-4fe904dd3343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:47.620397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60ae66-cab8-4f5a-a976-4fe904dd3343 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:47.621197 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60ae66-cab8-4f5a-a976-4fe904dd3343 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:47.621473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60ae66-cab8-4f5a-a976-4fe904dd3343 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:47.622128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60ae66-cab8-4f5a-a976-4fe904dd3343 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:47.622432 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60ae66-cab8-4f5a-a976-4fe904dd3343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:47.623851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60ae66-cab8-4f5a-a976-4fe904dd3343 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:47.631639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 98/196] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:17:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:47.632423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60ae66-cab8-4f5a-a976-4fe904dd3343 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:47.688964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f83e3-78f4-479d-9ac3-1d4c23870c7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:47.690353 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f83e3-78f4-479d-9ac3-1d4c23870c7e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:47.726456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:47.732440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60ae66-cab8-4f5a-a976-4fe904dd3343 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:47.738416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:47.766069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f963b-dca4-4427-9f2b-2ff694577b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:47.766698 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f963b-dca4-4427-9f2b-2ff694577b72 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:47.767010 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f963b-dca4-4427-9f2b-2ff694577b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:47.767282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f963b-dca4-4427-9f2b-2ff694577b72 None admin] PATH_INFO: `/v3/users/daeff8cc66794def963471dead837af5` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:47.780653 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f963b-dca4-4427-9f2b-2ff694577b72 None admin] RBAC: Authorizing `identity:get_user(user_id=daeff8cc66794def963471dead837af5)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:47.782097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f963b-dca4-4427-9f2b-2ff694577b72 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:47.783751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 99/197] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:47 2022] GET /identity/v3/users/daeff8cc66794def963471dead837af5 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:47.784498 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f963b-dca4-4427-9f2b-2ff694577b72 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:47.793052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 99/198] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:17:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:17:47.794564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f83e3-78f4-479d-9ac3-1d4c23870c7e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:47.884637 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f963b-dca4-4427-9f2b-2ff694577b72 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:47.892420 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f83e3-78f4-479d-9ac3-1d4c23870c7e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:47.918910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50280d-a4f1-400f-a7b0-c261db536840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:47.919514 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50280d-a4f1-400f-a7b0-c261db536840 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:47.919788 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50280d-a4f1-400f-a7b0-c261db536840 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:47.920057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50280d-a4f1-400f-a7b0-c261db536840 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:47.920694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50280d-a4f1-400f-a7b0-c261db536840 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:47.922113 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50280d-a4f1-400f-a7b0-c261db536840 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:47.926551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00ee36-846c-49fd-90fe-c244c3b855cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:47.927212 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00ee36-846c-49fd-90fe-c244c3b855cf None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:47.927490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00ee36-846c-49fd-90fe-c244c3b855cf None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:47.927759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00ee36-846c-49fd-90fe-c244c3b855cf None admin] PATH_INFO: `/v3/users/daeff8cc66794def963471dead837af5` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:47.928872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00ee36-846c-49fd-90fe-c244c3b855cf None admin] RBAC: Authorizing `identity:get_user(user_id=daeff8cc66794def963471dead837af5)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:47.930284 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00ee36-846c-49fd-90fe-c244c3b855cf None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:47.931901 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 100/199] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:47 2022] GET /identity/v3/users/daeff8cc66794def963471dead837af5 => generated 283 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:47.933780 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00ee36-846c-49fd-90fe-c244c3b855cf None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:47.953302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 100/200] 10.222.0.25 () {60 vars in 1132 bytes} [Sat Sep 24 19:17:47 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:17:47.954367 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50280d-a4f1-400f-a7b0-c261db536840 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:47.957704 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:47.970229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:48.055423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00ee36-846c-49fd-90fe-c244c3b855cf None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:48.075791 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50280d-a4f1-400f-a7b0-c261db536840 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:48.094095 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1f04b-c3de-4b98-8037-75742660dbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:48.094845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f04b-c3de-4b98-8037-75742660dbf9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:48.095129 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f04b-c3de-4b98-8037-75742660dbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:48.095395 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f04b-c3de-4b98-8037-75742660dbf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:48.113329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a923cf8-b9ef-4ba8-843d-faa245ffcacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:48.114083 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a923cf8-b9ef-4ba8-843d-faa245ffcacb None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:48.114439 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a923cf8-b9ef-4ba8-843d-faa245ffcacb None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:48.114713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a923cf8-b9ef-4ba8-843d-faa245ffcacb None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:48.115997 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a923cf8-b9ef-4ba8-843d-faa245ffcacb None admin] RBAC: Authorizing `identity:get_project(project_id=9bbb5023e47c45f49813194c41890827)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:48.117456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a923cf8-b9ef-4ba8-843d-faa245ffcacb None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:48.119144 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 101/201] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:47 2022] GET /identity/v3/projects/9bbb5023e47c45f49813194c41890827 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:48.119909 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a923cf8-b9ef-4ba8-843d-faa245ffcacb None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:48.180502 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1f04b-c3de-4b98-8037-75742660dbf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:48.181986 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1f04b-c3de-4b98-8037-75742660dbf9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:48.205020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:48.210669 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:48.242148 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a923cf8-b9ef-4ba8-843d-faa245ffcacb None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:48.298532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e8d5a-28ad-427c-9371-ecd74a92a01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:48.299213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e8d5a-28ad-427c-9371-ecd74a92a01b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:48.299498 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e8d5a-28ad-427c-9371-ecd74a92a01b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:48.299770 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e8d5a-28ad-427c-9371-ecd74a92a01b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:48.318916 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 101/202] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:17:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:17:48.318916 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1f04b-c3de-4b98-8037-75742660dbf9 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:48.401547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e8d5a-28ad-427c-9371-ecd74a92a01b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:48.404062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e8d5a-28ad-427c-9371-ecd74a92a01b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:48.438550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1f04b-c3de-4b98-8037-75742660dbf9 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:48.458576 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:48.477518 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b42d8-31c9-4f83-b224-e1aab87973d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:48.478502 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b42d8-31c9-4f83-b224-e1aab87973d2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:48.479036 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b42d8-31c9-4f83-b224-e1aab87973d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:48.479508 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b42d8-31c9-4f83-b224-e1aab87973d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:48.480551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b42d8-31c9-4f83-b224-e1aab87973d2 None admin] RBAC: Adding query filter params (role.id=4b618f407f654e32a6a29da3aa4f83e2, scope.project.id=9bbb5023e47c45f49813194c41890827, user.id=09008a3af37a418cab1a930f2af79f83) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:48.481250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b42d8-31c9-4f83-b224-e1aab87973d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:48.482951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b42d8-31c9-4f83-b224-e1aab87973d2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:48.489825 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 102/203] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:17:48 2022] GET /identity/v3/role_assignments?user.id=09008a3af37a418cab1a930f2af79f83&scope.project.id=9bbb5023e47c45f49813194c41890827&role.id=4b618f407f654e32a6a29da3aa4f83e2 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:48.490892 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b42d8-31c9-4f83-b224-e1aab87973d2 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:48.510931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:48.545016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 102/204] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:17:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:17:48.550858 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e8d5a-28ad-427c-9371-ecd74a92a01b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:48.607119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b42d8-31c9-4f83-b224-e1aab87973d2 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:48.645433 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b3dcc-c40c-4f6c-95f9-2e1e350a7c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:48.646213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b3dcc-c40c-4f6c-95f9-2e1e350a7c43 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:48.646389 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b3dcc-c40c-4f6c-95f9-2e1e350a7c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:48.646618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b3dcc-c40c-4f6c-95f9-2e1e350a7c43 None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:48.647804 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b3dcc-c40c-4f6c-95f9-2e1e350a7c43 None admin] RBAC: Authorizing `identity:get_project(project_id=54174d12726547b4bb37d9dd5c21798a)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:48.649573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b3dcc-c40c-4f6c-95f9-2e1e350a7c43 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:48.651324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 103/205] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:48 2022] GET /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:48.657286 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b3dcc-c40c-4f6c-95f9-2e1e350a7c43 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:48.661059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e8d5a-28ad-427c-9371-ecd74a92a01b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:48.697964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6bd42-21e4-4c8f-a511-0b9b4188256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:48.699539 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6bd42-21e4-4c8f-a511-0b9b4188256c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:48.700054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6bd42-21e4-4c8f-a511-0b9b4188256c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:48.700517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6bd42-21e4-4c8f-a511-0b9b4188256c None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:48.702037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d6bd42-21e4-4c8f-a511-0b9b4188256c None admin] RBAC: Authorizing `identity:get_project(project_id=54174d12726547b4bb37d9dd5c21798a)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:48.703712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d6bd42-21e4-4c8f-a511-0b9b4188256c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:48.705912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 103/206] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:48 2022] GET /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:48.712099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6bd42-21e4-4c8f-a511-0b9b4188256c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:48.715656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:48.773907 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b3dcc-c40c-4f6c-95f9-2e1e350a7c43 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:48.812026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bb436-d54b-4270-a2c5-45fa9cee7bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:48.812642 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bb436-d54b-4270-a2c5-45fa9cee7bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:48.812908 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bb436-d54b-4270-a2c5-45fa9cee7bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:48.813196 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bb436-d54b-4270-a2c5-45fa9cee7bc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:48.813904 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42bb436-d54b-4270-a2c5-45fa9cee7bc5 None admin] RBAC: Adding query filter params (role.id=dd27845a836a4f6ebece149dbebc59c0, scope.project.id=54174d12726547b4bb37d9dd5c21798a, user.id=daeff8cc66794def963471dead837af5) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:48.814213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42bb436-d54b-4270-a2c5-45fa9cee7bc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:48.815690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42bb436-d54b-4270-a2c5-45fa9cee7bc5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:48.822059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 104/207] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:17:48 2022] GET /identity/v3/role_assignments?user.id=daeff8cc66794def963471dead837af5&scope.project.id=54174d12726547b4bb37d9dd5c21798a&role.id=dd27845a836a4f6ebece149dbebc59c0 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:48.835560 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:48.899622 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6bd42-21e4-4c8f-a511-0b9b4188256c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:48.940143 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8f871-b9d6-44f3-894a-2a84b3424b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:48.941001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8f871-b9d6-44f3-894a-2a84b3424b4e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:48.941419 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8f871-b9d6-44f3-894a-2a84b3424b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:48.941826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8f871-b9d6-44f3-894a-2a84b3424b4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:48.942698 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8f871-b9d6-44f3-894a-2a84b3424b4e None admin] RBAC: Adding query filter params (role.id=655c93c88bc34badbfd2aad45491a96b, scope.project.id=54174d12726547b4bb37d9dd5c21798a, user.id=daeff8cc66794def963471dead837af5) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:48.943189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8f871-b9d6-44f3-894a-2a84b3424b4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:48.944863 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8f871-b9d6-44f3-894a-2a84b3424b4e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:48.952404 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 104/208] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:17:48 2022] GET /identity/v3/role_assignments?user.id=daeff8cc66794def963471dead837af5&scope.project.id=54174d12726547b4bb37d9dd5c21798a&role.id=655c93c88bc34badbfd2aad45491a96b => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:17:50.381818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748203b1-a262-41cd-bfae-fc4b4fbcc22b None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:50.382368 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748203b1-a262-41cd-bfae-fc4b4fbcc22b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:50.382368 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748203b1-a262-41cd-bfae-fc4b4fbcc22b None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:50.384135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 105/209] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:50.389428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bb17b-3d50-439b-af73-41455844b913 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:50.389818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bb17b-3d50-439b-af73-41455844b913 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:50.390000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bb17b-3d50-439b-af73-41455844b913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:50.409213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-cb1bb17b-3d50-439b-af73-41455844b913 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:50.410399 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-cb1bb17b-3d50-439b-af73-41455844b913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:50.459618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc82331-bd88-4bb5-a0c6-afd3c0624cc6 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:50.460036 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc82331-bd88-4bb5-a0c6-afd3c0624cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:50.460410 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc82331-bd88-4bb5-a0c6-afd3c0624cc6 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:50.461868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 106/210] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:17:50.467550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d0540-ef39-4b1a-96c9-065659564b4b None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:50.467836 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d0540-ef39-4b1a-96c9-065659564b4b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:50.468113 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d0540-ef39-4b1a-96c9-065659564b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:50.480010 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 105/211] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:50.489765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-5a1d0540-ef39-4b1a-96c9-065659564b4b None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:50.490963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5a1d0540-ef39-4b1a-96c9-065659564b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:50.562129 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 107/212] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:17:50.754506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1bb17b-3d50-439b-af73-41455844b913 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:50.798116 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:50.842178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d0540-ef39-4b1a-96c9-065659564b4b None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:50.858105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1bb17b-3d50-439b-af73-41455844b913 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:50.893744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60ca67-3a76-4b77-a6d2-7a13bef2c7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:50.894381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60ca67-3a76-4b77-a6d2-7a13bef2c7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:50.894652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60ca67-3a76-4b77-a6d2-7a13bef2c7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:50.894949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60ca67-3a76-4b77-a6d2-7a13bef2c7b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:50.896044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60ca67-3a76-4b77-a6d2-7a13bef2c7b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:50.897486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60ca67-3a76-4b77-a6d2-7a13bef2c7b5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:50.898110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:50.899337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 106/213] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:17:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:50.906132 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60ca67-3a76-4b77-a6d2-7a13bef2c7b5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:50.968007 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d0540-ef39-4b1a-96c9-065659564b4b None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:51.010115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6b857-c8b3-4d14-a4c0-3bc039ef32dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:51.010816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6b857-c8b3-4d14-a4c0-3bc039ef32dc None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:51.011138 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6b857-c8b3-4d14-a4c0-3bc039ef32dc None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:51.012207 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6b857-c8b3-4d14-a4c0-3bc039ef32dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:51.025562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6b857-c8b3-4d14-a4c0-3bc039ef32dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:51.030596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-78f6b857-c8b3-4d14-a4c0-3bc039ef32dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:17:51.030596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:51.030596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:51.030596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:51.030596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:51.030596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:51.030596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:51.030596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:51.030596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:51.030596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:51.030596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:51.030596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:51.030596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:51.030596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:51.030596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:51.030596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:51.031575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:51.031575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:51.031575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:51.031575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:51.031575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:51.031575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:51.031575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:51.031575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:51.031575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:51.031575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:51.031575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:51.031575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:51.031575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:51.031575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:51.031575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:51.031575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:51.032362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:51.032362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:51.032362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:51.032362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:51.032362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:51.032362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:51.032362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:51.032362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:51.032362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:51.032362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:51.032362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:17:51.032362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:17:51.032978 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60ca67-3a76-4b77-a6d2-7a13bef2c7b5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:51.036845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 108/214] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:17:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:17:51.038362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6b857-c8b3-4d14-a4c0-3bc039ef32dc None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:51.046926 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:51.087732 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defba8c8-9446-46a8-a798-d93b511df5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:51.088352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defba8c8-9446-46a8-a798-d93b511df5fa None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:51.088631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defba8c8-9446-46a8-a798-d93b511df5fa None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:51.088904 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defba8c8-9446-46a8-a798-d93b511df5fa None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:51.089643 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defba8c8-9446-46a8-a798-d93b511df5fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:51.091341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defba8c8-9446-46a8-a798-d93b511df5fa None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:51.118662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 107/215] 10.222.0.25 () {60 vars in 1132 bytes} [Sat Sep 24 19:17:50 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:17:51.167011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6b857-c8b3-4d14-a4c0-3bc039ef32dc None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:51.171253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fbcde-0cf6-4725-8e54-0cee7b86eb8c None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:51.171253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fbcde-0cf6-4725-8e54-0cee7b86eb8c None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:51.171253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fbcde-0cf6-4725-8e54-0cee7b86eb8c None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:51.172774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 108/216] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:17:51.177296 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:51.181676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259fdff-6c6e-459b-94ce-bb8c4797db79 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:51.182008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259fdff-6c6e-459b-94ce-bb8c4797db79 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:51.182229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259fdff-6c6e-459b-94ce-bb8c4797db79 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:51.184061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 109/217] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:17:51.185334 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f928a0-d5a1-41eb-86bc-75cfaaa23bc3 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:51.185631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f928a0-d5a1-41eb-86bc-75cfaaa23bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:51.185893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f928a0-d5a1-41eb-86bc-75cfaaa23bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:51.210341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-05f928a0-d5a1-41eb-86bc-75cfaaa23bc3 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:51.210934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c20162-b1a8-45e7-9c6f-c299975f228a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:51.211551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c20162-b1a8-45e7-9c6f-c299975f228a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:51.211690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-05f928a0-d5a1-41eb-86bc-75cfaaa23bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:51.211867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c20162-b1a8-45e7-9c6f-c299975f228a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:51.212093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c20162-b1a8-45e7-9c6f-c299975f228a None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:51.212765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c20162-b1a8-45e7-9c6f-c299975f228a None admin] RBAC: Adding query filter params (name=member) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:51.213049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c20162-b1a8-45e7-9c6f-c299975f228a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:51.216274 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c20162-b1a8-45e7-9c6f-c299975f228a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:51.231885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 109/218] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:17:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:17:51.231885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f15170-e8d3-40bd-af0b-5149b8a5f6fa None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:51.231885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f15170-e8d3-40bd-af0b-5149b8a5f6fa None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:51.231885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f15170-e8d3-40bd-af0b-5149b8a5f6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:51.250707 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-20f15170-e8d3-40bd-af0b-5149b8a5f6fa None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:51.251951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-20f15170-e8d3-40bd-af0b-5149b8a5f6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:51.289242 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 110/219] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:51.290083 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f928a0-d5a1-41eb-86bc-75cfaaa23bc3 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:51.337423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 110/220] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:51.403204 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:51.406217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f928a0-d5a1-41eb-86bc-75cfaaa23bc3 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:51.444093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b9111-a810-4a46-ad8b-63acfd1bfc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:51.444751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b9111-a810-4a46-ad8b-63acfd1bfc5f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:51.445027 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b9111-a810-4a46-ad8b-63acfd1bfc5f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:51.445289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b9111-a810-4a46-ad8b-63acfd1bfc5f None admin] PATH_INFO: `/v3/users/9beba998b73a474ba7482e45028d1c8c` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:51.459410 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b9111-a810-4a46-ad8b-63acfd1bfc5f None admin] RBAC: Authorizing `identity:get_user(user_id=9beba998b73a474ba7482e45028d1c8c)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:51.460843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b9111-a810-4a46-ad8b-63acfd1bfc5f None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:51.462483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 111/221] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:51 2022] GET /identity/v3/users/9beba998b73a474ba7482e45028d1c8c => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:51.468107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f15170-e8d3-40bd-af0b-5149b8a5f6fa None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:51.571285 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:51.578687 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f15170-e8d3-40bd-af0b-5149b8a5f6fa None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:51.588591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b9111-a810-4a46-ad8b-63acfd1bfc5f None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:51.624494 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523b51f-9350-4a0a-9572-6813cddaa8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:51.625547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523b51f-9350-4a0a-9572-6813cddaa8e2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:51.626097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523b51f-9350-4a0a-9572-6813cddaa8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:51.626378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523b51f-9350-4a0a-9572-6813cddaa8e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:51.712466 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b9111-a810-4a46-ad8b-63acfd1bfc5f None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:51.718737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523b51f-9350-4a0a-9572-6813cddaa8e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:51.720765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523b51f-9350-4a0a-9572-6813cddaa8e2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:51.749919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ad447-a61e-4707-9d55-fa7923a2387f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:51.750569 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ad447-a61e-4707-9d55-fa7923a2387f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:51.750890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ad447-a61e-4707-9d55-fa7923a2387f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:51.751181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ad447-a61e-4707-9d55-fa7923a2387f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:51.762300 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ad447-a61e-4707-9d55-fa7923a2387f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:51.767792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-c71ad447-a61e-4707-9d55-fa7923a2387f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:17:51.767792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:51.767792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:51.767792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:51.767792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:51.767792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:51.767792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:51.767792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:51.767792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:51.767792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:51.767792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:51.767792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:51.767792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:51.767792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:51.767792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:51.767792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:51.768671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:51.768671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:51.768671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:51.768671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:51.768671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:51.768671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:51.768671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:51.768671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:51.768671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:51.768671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:51.768671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:51.768671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:51.768671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:51.768671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:51.768671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:51.768671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:51.769474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:51.769474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:51.769474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:51.769474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:51.769474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:51.769474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:51.769474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:51.769474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:51.769474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:51.769474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:51.769474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:17:51.769474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:17:51.769474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 112/222] 10.222.0.25 () {56 vars in 1114 bytes} [Sat Sep 24 19:17:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:51.770605 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ad447-a61e-4707-9d55-fa7923a2387f None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:51.788555 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:51.848713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:51.858409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 111/223] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:17:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:17:51.859793 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523b51f-9350-4a0a-9572-6813cddaa8e2 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:51.885426 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ad447-a61e-4707-9d55-fa7923a2387f None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:51.924578 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22704df-dbae-48b5-b16d-91f48654d362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:51.925511 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22704df-dbae-48b5-b16d-91f48654d362 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:51.925894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22704df-dbae-48b5-b16d-91f48654d362 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:51.926343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22704df-dbae-48b5-b16d-91f48654d362 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:51.938362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22704df-dbae-48b5-b16d-91f48654d362 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:51.944493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-d22704df-dbae-48b5-b16d-91f48654d362 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:17:51.944493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:51.944493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:51.944493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:51.944493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:51.944493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:51.944493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:51.944493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:51.944493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:51.944493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:51.944493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:51.944493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:51.944493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:51.944493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:51.944493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:51.944493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:51.946356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:51.946356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:51.946356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:51.946356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:51.946356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:51.946356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:51.946356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:51.946356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:51.946356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:51.946356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:51.946356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:51.946356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:51.946356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:51.946356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:51.946356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:51.946356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:51.948393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:51.948393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:51.948393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:51.948393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:51.948393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:51.948393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:51.948393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:51.948393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:51.948393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:51.948393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:51.948393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:17:51.948393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:17:51.948393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 113/224] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:17:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:51.959099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22704df-dbae-48b5-b16d-91f48654d362 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:51.987469 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523b51f-9350-4a0a-9572-6813cddaa8e2 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:52.026070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e275b6a-0c6a-44d7-966e-b6a0c5f231ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:52.026680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e275b6a-0c6a-44d7-966e-b6a0c5f231ec None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:52.027518 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e275b6a-0c6a-44d7-966e-b6a0c5f231ec None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:52.027798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e275b6a-0c6a-44d7-966e-b6a0c5f231ec None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:52.028589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e275b6a-0c6a-44d7-966e-b6a0c5f231ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:52.028908 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e275b6a-0c6a-44d7-966e-b6a0c5f231ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:52.030292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e275b6a-0c6a-44d7-966e-b6a0c5f231ec None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:52.039443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 112/225] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:17:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:52.040159 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e275b6a-0c6a-44d7-966e-b6a0c5f231ec None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:52.047698 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:52.088819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22704df-dbae-48b5-b16d-91f48654d362 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:52.124915 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:52.131255 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41f914-f7df-406b-aae0-9dab181d3d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:52.132016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41f914-f7df-406b-aae0-9dab181d3d46 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:52.132318 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41f914-f7df-406b-aae0-9dab181d3d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:52.132684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41f914-f7df-406b-aae0-9dab181d3d46 None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:52.133902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41f914-f7df-406b-aae0-9dab181d3d46 None admin] RBAC: Authorizing `identity:get_project(project_id=54174d12726547b4bb37d9dd5c21798a)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:52.135480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41f914-f7df-406b-aae0-9dab181d3d46 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:52.137505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 114/226] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:51 2022] GET /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:52.138490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41f914-f7df-406b-aae0-9dab181d3d46 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:52.183109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e275b6a-0c6a-44d7-966e-b6a0c5f231ec None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:52.234227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e727ae8-d934-4638-94da-79005b34b6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:52.235246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e727ae8-d934-4638-94da-79005b34b6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:52.236220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e727ae8-d934-4638-94da-79005b34b6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:52.236711 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e727ae8-d934-4638-94da-79005b34b6d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:52.237817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e727ae8-d934-4638-94da-79005b34b6d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:52.238569 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e727ae8-d934-4638-94da-79005b34b6d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:52.240905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e727ae8-d934-4638-94da-79005b34b6d0 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:52.248929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41f914-f7df-406b-aae0-9dab181d3d46 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:52.253378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 113/227] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:17:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:52.254479 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e727ae8-d934-4638-94da-79005b34b6d0 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:52.293937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e0377-50b4-4e3d-bf28-aeed378210dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:52.294573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e0377-50b4-4e3d-bf28-aeed378210dc None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:52.294913 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e0377-50b4-4e3d-bf28-aeed378210dc None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:52.295248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e0377-50b4-4e3d-bf28-aeed378210dc None admin] PATH_INFO: `/v3/users/daeff8cc66794def963471dead837af5` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:52.296579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e0377-50b4-4e3d-bf28-aeed378210dc None admin] RBAC: Authorizing `identity:get_user(user_id=daeff8cc66794def963471dead837af5)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:52.297898 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e0377-50b4-4e3d-bf28-aeed378210dc None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:52.299964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 115/228] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:52 2022] GET /identity/v3/users/daeff8cc66794def963471dead837af5 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:52.300849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e0377-50b4-4e3d-bf28-aeed378210dc None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:52.314890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:52.394707 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e727ae8-d934-4638-94da-79005b34b6d0 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:52.426422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:52.442360 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0da1c-7d0f-4c18-8f13-83a4990c7ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:52.442664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e0377-50b4-4e3d-bf28-aeed378210dc None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:52.443126 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0da1c-7d0f-4c18-8f13-83a4990c7ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:52.443290 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0da1c-7d0f-4c18-8f13-83a4990c7ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:52.443539 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0da1c-7d0f-4c18-8f13-83a4990c7ea7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:52.444253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0da1c-7d0f-4c18-8f13-83a4990c7ea7 None admin] RBAC: Adding query filter params (role.id=ef0525432e044dd18b3ae4b32d29030e, scope.project.id=54174d12726547b4bb37d9dd5c21798a, user.id=9beba998b73a474ba7482e45028d1c8c) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:52.444561 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0da1c-7d0f-4c18-8f13-83a4990c7ea7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:52.446008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0da1c-7d0f-4c18-8f13-83a4990c7ea7 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:52.452237 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 114/229] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:17:52 2022] GET /identity/v3/role_assignments?user.id=9beba998b73a474ba7482e45028d1c8c&scope.project.id=54174d12726547b4bb37d9dd5c21798a&role.id=ef0525432e044dd18b3ae4b32d29030e => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:52.453119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0da1c-7d0f-4c18-8f13-83a4990c7ea7 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:52.484572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c57be-610b-4373-a287-0f6d4f26c5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:52.485662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c57be-610b-4373-a287-0f6d4f26c5a6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:52.486170 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c57be-610b-4373-a287-0f6d4f26c5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:52.486709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c57be-610b-4373-a287-0f6d4f26c5a6 None admin] PATH_INFO: `/v3/users/daeff8cc66794def963471dead837af5` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:52.488425 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c57be-610b-4373-a287-0f6d4f26c5a6 None admin] RBAC: Authorizing `identity:get_user(user_id=daeff8cc66794def963471dead837af5)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:52.490185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c57be-610b-4373-a287-0f6d4f26c5a6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:52.492246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 116/230] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:52 2022] GET /identity/v3/users/daeff8cc66794def963471dead837af5 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:52.507744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c57be-610b-4373-a287-0f6d4f26c5a6 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:52.576940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0da1c-7d0f-4c18-8f13-83a4990c7ea7 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:52.655986 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6995384-01d8-4ebc-a3d5-e96011b5db73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:52.656559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6995384-01d8-4ebc-a3d5-e96011b5db73 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:52.656838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6995384-01d8-4ebc-a3d5-e96011b5db73 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:52.657109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6995384-01d8-4ebc-a3d5-e96011b5db73 None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:52.658348 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6995384-01d8-4ebc-a3d5-e96011b5db73 None admin] RBAC: Authorizing `identity:get_project(project_id=54174d12726547b4bb37d9dd5c21798a)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:52.659942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6995384-01d8-4ebc-a3d5-e96011b5db73 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:52.661640 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 115/231] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:52 2022] GET /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:52.664835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:52.671912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6995384-01d8-4ebc-a3d5-e96011b5db73 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:52.694343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c57be-610b-4373-a287-0f6d4f26c5a6 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:52.739440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c1acd-a7e7-460d-b964-d245cc633ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:52.740646 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c1acd-a7e7-460d-b964-d245cc633ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:52.741132 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c1acd-a7e7-460d-b964-d245cc633ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:52.741591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c1acd-a7e7-460d-b964-d245cc633ef3 None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:52.743112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c1acd-a7e7-460d-b964-d245cc633ef3 None admin] RBAC: Authorizing `identity:get_project(project_id=54174d12726547b4bb37d9dd5c21798a)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:52.744876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c1acd-a7e7-460d-b964-d245cc633ef3 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:52.748131 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 117/232] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:52 2022] GET /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:52.757294 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c1acd-a7e7-460d-b964-d245cc633ef3 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:52.759297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:52.812541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6995384-01d8-4ebc-a3d5-e96011b5db73 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:52.857065 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662d9f9-8efb-4e95-9acf-4f354554673b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:52.857733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662d9f9-8efb-4e95-9acf-4f354554673b None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:52.858013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662d9f9-8efb-4e95-9acf-4f354554673b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:52.858288 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662d9f9-8efb-4e95-9acf-4f354554673b None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a/users/daeff8cc66794def963471dead837af5/roles/655c93c88bc34badbfd2aad45491a96b` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:52.866105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662d9f9-8efb-4e95-9acf-4f354554673b None admin] RBAC: Authorizing `identity:create_grant(project_id=54174d12726547b4bb37d9dd5c21798a, user_id=daeff8cc66794def963471dead837af5, role_id=655c93c88bc34badbfd2aad45491a96b)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:52.867590 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662d9f9-8efb-4e95-9acf-4f354554673b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:52.888742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 116/233] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:17:52 2022] PUT /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a/users/daeff8cc66794def963471dead837af5/roles/655c93c88bc34badbfd2aad45491a96b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:17:52.922461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c1acd-a7e7-460d-b964-d245cc633ef3 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:52.978941 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a48e67-098e-4fdd-b207-a59473449c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:52.979759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a48e67-098e-4fdd-b207-a59473449c77 None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:52.980619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a48e67-098e-4fdd-b207-a59473449c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:52.980957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a48e67-098e-4fdd-b207-a59473449c77 None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a/users/daeff8cc66794def963471dead837af5/roles/dd27845a836a4f6ebece149dbebc59c0` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:52.983060 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a48e67-098e-4fdd-b207-a59473449c77 None admin] RBAC: Authorizing `identity:create_grant(project_id=54174d12726547b4bb37d9dd5c21798a, user_id=daeff8cc66794def963471dead837af5, role_id=dd27845a836a4f6ebece149dbebc59c0)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:52.984716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a48e67-098e-4fdd-b207-a59473449c77 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:53.006513 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 118/234] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:17:52 2022] PUT /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a/users/daeff8cc66794def963471dead837af5/roles/dd27845a836a4f6ebece149dbebc59c0 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:17:53.754357 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7d828-ca27-4759-8dbc-eae39652e7e6 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:53.754884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7d828-ca27-4759-8dbc-eae39652e7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:53.754963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7d828-ca27-4759-8dbc-eae39652e7e6 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:53.756475 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 117/235] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:53.762611 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07d80c-71e1-411c-8943-bf51cb084603 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:53.763050 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07d80c-71e1-411c-8943-bf51cb084603 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:53.763240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07d80c-71e1-411c-8943-bf51cb084603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:53.771688 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:53.792085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-ca07d80c-71e1-411c-8943-bf51cb084603 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:53.793938 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ca07d80c-71e1-411c-8943-bf51cb084603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:53.885445 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 119/236] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:17:53.969389 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56c3db-a974-40d6-a7d9-2df6ccfbbd90 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:53.969710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56c3db-a974-40d6-a7d9-2df6ccfbbd90 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:53.969930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56c3db-a974-40d6-a7d9-2df6ccfbbd90 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:53.971472 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 118/237] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:53.976765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76612018-8dd4-4f93-8de8-3d31491a9774 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:53.977051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76612018-8dd4-4f93-8de8-3d31491a9774 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:53.977328 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76612018-8dd4-4f93-8de8-3d31491a9774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:53.996435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-76612018-8dd4-4f93-8de8-3d31491a9774 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:53.997618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-76612018-8dd4-4f93-8de8-3d31491a9774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:54.084205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 120/238] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:17:54.202138 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56c3db-a974-40d6-a7d9-2df6ccfbbd90 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:54.318416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56c3db-a974-40d6-a7d9-2df6ccfbbd90 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:54.338732 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:54.363871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195a25b-df49-4dd5-93b2-bd75c84063cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:54.364493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195a25b-df49-4dd5-93b2-bd75c84063cf None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:54.364766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195a25b-df49-4dd5-93b2-bd75c84063cf None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:54.365036 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195a25b-df49-4dd5-93b2-bd75c84063cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:54.383821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195a25b-df49-4dd5-93b2-bd75c84063cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:54.388923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-6195a25b-df49-4dd5-93b2-bd75c84063cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:17:54.388923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:54.388923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:54.388923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:54.388923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:54.388923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:54.388923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:54.388923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:54.388923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:54.388923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:54.388923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:54.388923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:54.388923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:54.388923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:54.388923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:54.388923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:54.389823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:54.389823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:54.389823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:54.389823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:54.389823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:54.389823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:54.389823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:54.389823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:54.389823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:54.389823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:54.389823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:54.389823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:54.389823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:54.389823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:54.389823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:54.389823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:54.390633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:54.390633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:54.390633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:54.390633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:54.390633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:54.390633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:54.390633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:54.390633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:54.390633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:54.390633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:54.390633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:17:54.390633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:17:54.390633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 119/239] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:17:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:54.395836 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76612018-8dd4-4f93-8de8-3d31491a9774 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:54.488214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:54.518646 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195a25b-df49-4dd5-93b2-bd75c84063cf None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:54.534851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76612018-8dd4-4f93-8de8-3d31491a9774 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:54.598053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac9ec9-467f-4cf7-93c5-97aa9aabe26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:54.598585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac9ec9-467f-4cf7-93c5-97aa9aabe26c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:54.598879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac9ec9-467f-4cf7-93c5-97aa9aabe26c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:54.599154 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac9ec9-467f-4cf7-93c5-97aa9aabe26c None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:54.599824 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac9ec9-467f-4cf7-93c5-97aa9aabe26c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:54.600121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac9ec9-467f-4cf7-93c5-97aa9aabe26c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:54.601512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac9ec9-467f-4cf7-93c5-97aa9aabe26c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:54.614511 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 121/240] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:17:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:54.620161 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac9ec9-467f-4cf7-93c5-97aa9aabe26c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:54.687789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195a25b-df49-4dd5-93b2-bd75c84063cf None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:54.730793 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d7811-1a1c-469b-b585-c40bcf136f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:54.731676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d7811-1a1c-469b-b585-c40bcf136f34 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:54.731961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d7811-1a1c-469b-b585-c40bcf136f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:54.732236 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d7811-1a1c-469b-b585-c40bcf136f34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:54.735256 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d7811-1a1c-469b-b585-c40bcf136f34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:54.737923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d7811-1a1c-469b-b585-c40bcf136f34 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:54.739851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 120/241] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:17:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:17:54.745187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d7811-1a1c-469b-b585-c40bcf136f34 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:54.797037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:54.857628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d7811-1a1c-469b-b585-c40bcf136f34 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:54.872901 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac9ec9-467f-4cf7-93c5-97aa9aabe26c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:54.892317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa80c07-a181-4014-88c4-6027b2278f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:54.893206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa80c07-a181-4014-88c4-6027b2278f48 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:54.893630 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa80c07-a181-4014-88c4-6027b2278f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:54.894210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa80c07-a181-4014-88c4-6027b2278f48 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:54.895054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa80c07-a181-4014-88c4-6027b2278f48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:54.896769 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa80c07-a181-4014-88c4-6027b2278f48 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:54.922789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 121/242] 10.222.0.25 () {60 vars in 1132 bytes} [Sat Sep 24 19:17:54 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:17:54.940601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf8149-1f53-4fc6-b4c3-140d644ddea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:54.941536 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf8149-1f53-4fc6-b4c3-140d644ddea9 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:54.942056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf8149-1f53-4fc6-b4c3-140d644ddea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:54.942468 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf8149-1f53-4fc6-b4c3-140d644ddea9 None admin] PATH_INFO: `/v3/users/82f06ce7c247433d878a8419f2cb8150` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:54.955231 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:54.962408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf8149-1f53-4fc6-b4c3-140d644ddea9 None admin] RBAC: Authorizing `identity:get_user(user_id=82f06ce7c247433d878a8419f2cb8150)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:54.965726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf8149-1f53-4fc6-b4c3-140d644ddea9 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:54.967779 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 122/243] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:54 2022] GET /identity/v3/users/82f06ce7c247433d878a8419f2cb8150 => generated 297 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:17:54.973633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa80c07-a181-4014-88c4-6027b2278f48 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:55.091632 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:55.098353 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa80c07-a181-4014-88c4-6027b2278f48 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:55.137842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca0800-26c4-4ce5-8171-dde97e0ddf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:55.138769 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca0800-26c4-4ce5-8171-dde97e0ddf82 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:55.139238 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca0800-26c4-4ce5-8171-dde97e0ddf82 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:55.139652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca0800-26c4-4ce5-8171-dde97e0ddf82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:55.213667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca0800-26c4-4ce5-8171-dde97e0ddf82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:55.216036 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca0800-26c4-4ce5-8171-dde97e0ddf82 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:55.323446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 122/244] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:17:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:17:55.324617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:55.331205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf8149-1f53-4fc6-b4c3-140d644ddea9 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:55.377266 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe27f1-2274-481c-b5d5-a6ff039cab9c None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:55.377587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe27f1-2274-481c-b5d5-a6ff039cab9c None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:55.377815 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe27f1-2274-481c-b5d5-a6ff039cab9c None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:55.379443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 123/245] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:17:55.387283 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435bbff-b3f0-4c0a-878c-2bc00b6da8bb None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:55.387810 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435bbff-b3f0-4c0a-878c-2bc00b6da8bb None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:55.388230 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435bbff-b3f0-4c0a-878c-2bc00b6da8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:55.410489 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-6435bbff-b3f0-4c0a-878c-2bc00b6da8bb None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:55.414487 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6435bbff-b3f0-4c0a-878c-2bc00b6da8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:55.482602 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf8149-1f53-4fc6-b4c3-140d644ddea9 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:55.496100 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 124/246] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:55.526259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc143bc7-bc9b-45e6-8ec5-e865718a5f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:55.527390 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc143bc7-bc9b-45e6-8ec5-e865718a5f86 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:55.528167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc143bc7-bc9b-45e6-8ec5-e865718a5f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:55.528648 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc143bc7-bc9b-45e6-8ec5-e865718a5f86 None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:55.530183 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc143bc7-bc9b-45e6-8ec5-e865718a5f86 None admin] RBAC: Authorizing `identity:get_project(project_id=54174d12726547b4bb37d9dd5c21798a)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:55.531969 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc143bc7-bc9b-45e6-8ec5-e865718a5f86 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:55.534020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 123/247] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:55 2022] GET /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:17:55.540522 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435bbff-b3f0-4c0a-878c-2bc00b6da8bb None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:55.654034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d36cc-67b9-4ec3-8045-acd89dbd14f7 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:55.654328 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d36cc-67b9-4ec3-8045-acd89dbd14f7 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:55.654509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d36cc-67b9-4ec3-8045-acd89dbd14f7 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:55.656059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 124/248] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:55.664024 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862bef4-7021-4597-b247-0c3505701786 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:55.664967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862bef4-7021-4597-b247-0c3505701786 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:55.665467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862bef4-7021-4597-b247-0c3505701786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:55.666629 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435bbff-b3f0-4c0a-878c-2bc00b6da8bb None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:55.693880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-2862bef4-7021-4597-b247-0c3505701786 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:55.696249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2862bef4-7021-4597-b247-0c3505701786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:55.709277 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:55.722883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aefca8-11ad-44a8-8a7b-265f46324ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:55.723623 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aefca8-11ad-44a8-8a7b-265f46324ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:55.723907 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aefca8-11ad-44a8-8a7b-265f46324ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:55.724231 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aefca8-11ad-44a8-8a7b-265f46324ce3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:55.725024 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aefca8-11ad-44a8-8a7b-265f46324ce3 None admin] RBAC: Adding query filter params (role.id=4b618f407f654e32a6a29da3aa4f83e2, scope.project.id=54174d12726547b4bb37d9dd5c21798a, user.id=82f06ce7c247433d878a8419f2cb8150) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:55.725351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aefca8-11ad-44a8-8a7b-265f46324ce3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:55.727012 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aefca8-11ad-44a8-8a7b-265f46324ce3 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:55.733488 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 125/249] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:17:55 2022] GET /identity/v3/role_assignments?user.id=82f06ce7c247433d878a8419f2cb8150&scope.project.id=54174d12726547b4bb37d9dd5c21798a&role.id=4b618f407f654e32a6a29da3aa4f83e2 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:55.762932 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:55.791961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 125/250] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:17:55.814742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e50a51-48e8-40a1-b98e-4033fe66f140 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:55.815606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e50a51-48e8-40a1-b98e-4033fe66f140 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:55.816025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e50a51-48e8-40a1-b98e-4033fe66f140 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:55.817542 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 126/251] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:55.823230 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0d584-5b5a-4bca-a973-a5c4199d363f None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:55.824330 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0d584-5b5a-4bca-a973-a5c4199d363f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:55.824753 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0d584-5b5a-4bca-a973-a5c4199d363f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:55.828762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e50a51-48e8-40a1-b98e-4033fe66f140 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:55.846937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-87e0d584-5b5a-4bca-a973-a5c4199d363f None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:55.848494 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-87e0d584-5b5a-4bca-a973-a5c4199d363f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:55.971022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 126/252] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:55.989475 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e50a51-48e8-40a1-b98e-4033fe66f140 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:56.026725 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b9c57-cbc8-4dd2-8566-cf2e81a5a065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:56.027385 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b9c57-cbc8-4dd2-8566-cf2e81a5a065 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:56.027679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b9c57-cbc8-4dd2-8566-cf2e81a5a065 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:56.027923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b9c57-cbc8-4dd2-8566-cf2e81a5a065 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:56.039003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b9c57-cbc8-4dd2-8566-cf2e81a5a065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:56.044427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-170b9c57-cbc8-4dd2-8566-cf2e81a5a065 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:17:56.044427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:56.044427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:56.044427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:56.044427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:56.044427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:56.044427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:56.044427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:56.044427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:56.044427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:56.044427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:56.044427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:56.044427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:56.044427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:56.044427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:56.044427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:56.045352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:56.045352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:56.045352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:56.045352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:56.045352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:56.045352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:56.045352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:56.045352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:56.045352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:56.045352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:56.045352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:56.045352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:56.045352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:56.045352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:56.045352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:56.045352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:56.046146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:56.046146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:56.046146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:56.046146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:56.046146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:56.046146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:56.046146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:56.046146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:56.046146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:56.046146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:56.046146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:17:56.046146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:17:56.046146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 127/253] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:17:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:17:56.051693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0d584-5b5a-4bca-a973-a5c4199d363f None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:56.117387 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b9c57-cbc8-4dd2-8566-cf2e81a5a065 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:56.221695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:56.252939 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0d584-5b5a-4bca-a973-a5c4199d363f None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:56.286248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b9c57-cbc8-4dd2-8566-cf2e81a5a065 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:56.288985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:56.318939 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6f481-068d-44d0-a0cb-594b342fdcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:56.319808 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6f481-068d-44d0-a0cb-594b342fdcf5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:56.320255 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6f481-068d-44d0-a0cb-594b342fdcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:56.320667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6f481-068d-44d0-a0cb-594b342fdcf5 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:56.321505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6f481-068d-44d0-a0cb-594b342fdcf5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:56.321950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6f481-068d-44d0-a0cb-594b342fdcf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:56.323531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6f481-068d-44d0-a0cb-594b342fdcf5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:56.323892 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4109f-d5c9-4abf-942a-a21ade7e0858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:56.324631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4109f-d5c9-4abf-942a-a21ade7e0858 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:56.325004 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4109f-d5c9-4abf-942a-a21ade7e0858 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:56.325490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4109f-d5c9-4abf-942a-a21ade7e0858 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:56.343453 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 127/254] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:17:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:56.344316 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6f481-068d-44d0-a0cb-594b342fdcf5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:56.344969 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4109f-d5c9-4abf-942a-a21ade7e0858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:56.352619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-e0a4109f-d5c9-4abf-942a-a21ade7e0858 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:17:56.352619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:56.352619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:56.352619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:56.352619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:56.352619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:56.352619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:56.352619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:56.352619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:56.352619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:56.352619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:56.352619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:56.352619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:56.352619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:56.352619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:56.352619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:56.353506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:56.353506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:56.353506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:56.353506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:56.353506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:56.353506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:56.353506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:56.353506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:56.353506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:56.353506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:56.353506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:56.353506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:56.353506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:56.353506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:56.353506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:56.353506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:56.354333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:56.354333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:56.354333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:56.354333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:56.354333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:56.354333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:56.354333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:56.354333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:56.354333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:56.354333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:56.354333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:17:56.354333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:17:56.354333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 128/255] 10.222.0.25 () {56 vars in 1114 bytes} [Sat Sep 24 19:17:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:56.355769 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4109f-d5c9-4abf-942a-a21ade7e0858 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:56.517345 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4109f-d5c9-4abf-942a-a21ade7e0858 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:56.525713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6f481-068d-44d0-a0cb-594b342fdcf5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:56.539630 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:56.553409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df70ea-919f-460e-8603-d71c2ea7c3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:56.554099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df70ea-919f-460e-8603-d71c2ea7c3f7 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:56.554384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df70ea-919f-460e-8603-d71c2ea7c3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:56.554658 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df70ea-919f-460e-8603-d71c2ea7c3f7 None admin] PATH_INFO: `/v3/users/9beba998b73a474ba7482e45028d1c8c` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:56.555827 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df70ea-919f-460e-8603-d71c2ea7c3f7 None admin] RBAC: Authorizing `identity:get_user(user_id=9beba998b73a474ba7482e45028d1c8c)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:56.557605 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df70ea-919f-460e-8603-d71c2ea7c3f7 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:56.560066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 129/256] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:56 2022] GET /identity/v3/users/9beba998b73a474ba7482e45028d1c8c => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:56.560672 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df70ea-919f-460e-8603-d71c2ea7c3f7 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:56.623879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a75a99-a9e3-4780-bbfa-9a748928f9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:56.624529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a75a99-a9e3-4780-bbfa-9a748928f9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:56.624801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a75a99-a9e3-4780-bbfa-9a748928f9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:56.625074 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a75a99-a9e3-4780-bbfa-9a748928f9b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:56.653916 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a75a99-a9e3-4780-bbfa-9a748928f9b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:56.659365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-00a75a99-a9e3-4780-bbfa-9a748928f9b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:17:56.659365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:56.659365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:56.659365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:56.659365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:56.659365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:56.659365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:56.659365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:56.659365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:56.659365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:56.659365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:56.659365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:56.659365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:56.659365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:56.659365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:56.659365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:56.660249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:56.660249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:56.660249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:56.660249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:56.660249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:56.660249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:56.660249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:56.660249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:56.660249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:56.660249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:56.660249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:56.660249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:56.660249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:56.660249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:56.660249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:56.660249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:56.661054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:56.661054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:56.661054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:56.661054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:56.661054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:56.661054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:56.661054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:56.661054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:56.661054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:56.661054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:56.661054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:17:56.661054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:17:56.663848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df70ea-919f-460e-8603-d71c2ea7c3f7 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:56.667318 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 128/257] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:17:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:56.668172 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a75a99-a9e3-4780-bbfa-9a748928f9b0 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:56.705661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b39322-c9ec-4765-bd74-8cbe047aa742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:56.706276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b39322-c9ec-4765-bd74-8cbe047aa742 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:56.706550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b39322-c9ec-4765-bd74-8cbe047aa742 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:56.706819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b39322-c9ec-4765-bd74-8cbe047aa742 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:56.707500 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b39322-c9ec-4765-bd74-8cbe047aa742 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:56.707806 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b39322-c9ec-4765-bd74-8cbe047aa742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:56.709164 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b39322-c9ec-4765-bd74-8cbe047aa742 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:56.718188 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 130/258] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:17:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:56.719045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b39322-c9ec-4765-bd74-8cbe047aa742 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:56.763834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:56.773417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:56.831693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b39322-c9ec-4765-bd74-8cbe047aa742 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:56.875824 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bb437-c8db-41e0-ac1d-f8bea66ebb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:56.876543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bb437-c8db-41e0-ac1d-f8bea66ebb9d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:56.876877 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bb437-c8db-41e0-ac1d-f8bea66ebb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:56.877153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bb437-c8db-41e0-ac1d-f8bea66ebb9d None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:56.877836 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65bb437-c8db-41e0-ac1d-f8bea66ebb9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:56.878137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65bb437-c8db-41e0-ac1d-f8bea66ebb9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:56.879593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65bb437-c8db-41e0-ac1d-f8bea66ebb9d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:56.900988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 131/259] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:17:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:56.902558 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bb437-c8db-41e0-ac1d-f8bea66ebb9d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:56.910668 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a75a99-a9e3-4780-bbfa-9a748928f9b0 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:56.993847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ea041-bd16-48a1-ade7-263778a2b5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:56.994477 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ea041-bd16-48a1-ade7-263778a2b5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:56.994753 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ea041-bd16-48a1-ade7-263778a2b5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:56.995057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ea041-bd16-48a1-ade7-263778a2b5c6 None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:56.996232 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ea041-bd16-48a1-ade7-263778a2b5c6 None admin] RBAC: Authorizing `identity:get_project(project_id=54174d12726547b4bb37d9dd5c21798a)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:56.997687 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ea041-bd16-48a1-ade7-263778a2b5c6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:56.999362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 129/260] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:56 2022] GET /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a => generated 302 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:57.000135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ea041-bd16-48a1-ade7-263778a2b5c6 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:57.050043 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bb437-c8db-41e0-ac1d-f8bea66ebb9d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:57.051626 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:57.109054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74660b2-a364-4277-ba52-e22230e78a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:57.109702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74660b2-a364-4277-ba52-e22230e78a88 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:57.109978 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74660b2-a364-4277-ba52-e22230e78a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:57.110247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74660b2-a364-4277-ba52-e22230e78a88 None admin] PATH_INFO: `/v3/users/daeff8cc66794def963471dead837af5` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:57.113614 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74660b2-a364-4277-ba52-e22230e78a88 None admin] RBAC: Authorizing `identity:get_user(user_id=daeff8cc66794def963471dead837af5)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:57.115107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74660b2-a364-4277-ba52-e22230e78a88 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:57.116878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 132/261] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:56 2022] GET /identity/v3/users/daeff8cc66794def963471dead837af5 => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:57.117440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74660b2-a364-4277-ba52-e22230e78a88 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:57.198444 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ea041-bd16-48a1-ade7-263778a2b5c6 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:57.201476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:57.262978 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7185bb8-fe74-4c30-a402-0b206e0c9867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:57.263928 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7185bb8-fe74-4c30-a402-0b206e0c9867 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:57.264207 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7185bb8-fe74-4c30-a402-0b206e0c9867 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:57.265377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7185bb8-fe74-4c30-a402-0b206e0c9867 None admin] PATH_INFO: `/v3/users/daeff8cc66794def963471dead837af5` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:57.266564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7185bb8-fe74-4c30-a402-0b206e0c9867 None admin] RBAC: Authorizing `identity:get_user(user_id=daeff8cc66794def963471dead837af5)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:57.268039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7185bb8-fe74-4c30-a402-0b206e0c9867 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:57.270400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 130/262] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:56 2022] GET /identity/v3/users/daeff8cc66794def963471dead837af5 => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:57.271220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7185bb8-fe74-4c30-a402-0b206e0c9867 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:57.331574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74660b2-a364-4277-ba52-e22230e78a88 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:57.396377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639f39d-df81-41c3-969b-b0d3091ba607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:57.397086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639f39d-df81-41c3-969b-b0d3091ba607 None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:57.397423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639f39d-df81-41c3-969b-b0d3091ba607 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:57.397921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639f39d-df81-41c3-969b-b0d3091ba607 None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a/users/9beba998b73a474ba7482e45028d1c8c/roles/ef0525432e044dd18b3ae4b32d29030e` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:57.401493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639f39d-df81-41c3-969b-b0d3091ba607 None admin] RBAC: Authorizing `identity:create_grant(project_id=54174d12726547b4bb37d9dd5c21798a, user_id=9beba998b73a474ba7482e45028d1c8c, role_id=ef0525432e044dd18b3ae4b32d29030e)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:57.404584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639f39d-df81-41c3-969b-b0d3091ba607 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:57.424166 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 133/263] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:17:57 2022] PUT /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a/users/9beba998b73a474ba7482e45028d1c8c/roles/ef0525432e044dd18b3ae4b32d29030e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:17:57.425014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639f39d-df81-41c3-969b-b0d3091ba607 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:57.483765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7185bb8-fe74-4c30-a402-0b206e0c9867 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:57.494633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:57.588047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9178883-1661-4c2b-a6d6-dcf99a802706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:57.588722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9178883-1661-4c2b-a6d6-dcf99a802706 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:57.589009 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9178883-1661-4c2b-a6d6-dcf99a802706 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:57.589341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9178883-1661-4c2b-a6d6-dcf99a802706 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:57.657691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639f39d-df81-41c3-969b-b0d3091ba607 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:57.667693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:57.707868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9178883-1661-4c2b-a6d6-dcf99a802706 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:57.709358 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9178883-1661-4c2b-a6d6-dcf99a802706 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:57.729042 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3902198-d2fa-4a24-9ddd-237fbedb13a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:57.730799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3902198-d2fa-4a24-9ddd-237fbedb13a4 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:57.731351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3902198-d2fa-4a24-9ddd-237fbedb13a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:57.731839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3902198-d2fa-4a24-9ddd-237fbedb13a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:57.884007 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3902198-d2fa-4a24-9ddd-237fbedb13a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:57.885404 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3902198-d2fa-4a24-9ddd-237fbedb13a4 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:57.913912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 131/264] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:17:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:17:57.919902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9178883-1661-4c2b-a6d6-dcf99a802706 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:57.946360 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:58.104720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:58.146345 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 134/265] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:17:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:17:58.154537 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3902198-d2fa-4a24-9ddd-237fbedb13a4 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:58.191244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9178883-1661-4c2b-a6d6-dcf99a802706 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:58.276328 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a1380-96dd-4840-82da-c74b9838b86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:58.277193 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a1380-96dd-4840-82da-c74b9838b86e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:58.277473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a1380-96dd-4840-82da-c74b9838b86e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:58.277935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a1380-96dd-4840-82da-c74b9838b86e None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:58.279126 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a1380-96dd-4840-82da-c74b9838b86e None admin] RBAC: Authorizing `identity:get_project(project_id=54174d12726547b4bb37d9dd5c21798a)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:58.280610 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a1380-96dd-4840-82da-c74b9838b86e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:58.282567 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 132/266] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:57 2022] GET /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a => generated 302 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:58.290217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a1380-96dd-4840-82da-c74b9838b86e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:58.404850 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3902198-d2fa-4a24-9ddd-237fbedb13a4 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:58.413856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a1380-96dd-4840-82da-c74b9838b86e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:58.457549 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71778a9-36d4-4db2-b9f4-4cb15464d076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:58.458168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71778a9-36d4-4db2-b9f4-4cb15464d076 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:58.458444 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71778a9-36d4-4db2-b9f4-4cb15464d076 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:58.458712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71778a9-36d4-4db2-b9f4-4cb15464d076 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:58.459470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71778a9-36d4-4db2-b9f4-4cb15464d076 None admin] RBAC: Adding query filter params (role.id=655c93c88bc34badbfd2aad45491a96b, scope.project.id=54174d12726547b4bb37d9dd5c21798a, user.id=daeff8cc66794def963471dead837af5) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:58.459773 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71778a9-36d4-4db2-b9f4-4cb15464d076 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:58.461205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71778a9-36d4-4db2-b9f4-4cb15464d076 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:58.472863 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 133/267] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:17:58 2022] GET /identity/v3/role_assignments?user.id=daeff8cc66794def963471dead837af5&scope.project.id=54174d12726547b4bb37d9dd5c21798a&role.id=655c93c88bc34badbfd2aad45491a96b => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:17:58.474083 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bf65f-2fd7-4def-bef4-7986a18e9ac4 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:58.474366 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bf65f-2fd7-4def-bef4-7986a18e9ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:58.474640 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bf65f-2fd7-4def-bef4-7986a18e9ac4 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:58.475871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 134/268] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:58.478283 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:58.484415 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75034846-c507-418b-812d-d2f67b58e800 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:58.484752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75034846-c507-418b-812d-d2f67b58e800 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:58.484963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75034846-c507-418b-812d-d2f67b58e800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:58.489732 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373329bd-fc2d-4da1-b802-4cb535fa0814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:58.490382 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373329bd-fc2d-4da1-b802-4cb535fa0814 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:58.490659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373329bd-fc2d-4da1-b802-4cb535fa0814 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:58.490957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373329bd-fc2d-4da1-b802-4cb535fa0814 None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:58.492877 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373329bd-fc2d-4da1-b802-4cb535fa0814 None admin] RBAC: Authorizing `identity:get_project(project_id=54174d12726547b4bb37d9dd5c21798a)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:58.494318 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373329bd-fc2d-4da1-b802-4cb535fa0814 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:58.496028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 135/269] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:17:58 2022] GET /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a => generated 302 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:58.503448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373329bd-fc2d-4da1-b802-4cb535fa0814 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:58.511756 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:58.525236 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-75034846-c507-418b-812d-d2f67b58e800 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:58.526467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-75034846-c507-418b-812d-d2f67b58e800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:58.679302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 135/270] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:58.716027 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373329bd-fc2d-4da1-b802-4cb535fa0814 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:58.763590 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c585be6-c464-4a95-b0b5-d3e729c2c870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:58.764201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c585be6-c464-4a95-b0b5-d3e729c2c870 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:58.764482 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c585be6-c464-4a95-b0b5-d3e729c2c870 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:58.764750 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c585be6-c464-4a95-b0b5-d3e729c2c870 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:58.765471 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c585be6-c464-4a95-b0b5-d3e729c2c870 None admin] RBAC: Adding query filter params (role.id=dd27845a836a4f6ebece149dbebc59c0, scope.project.id=54174d12726547b4bb37d9dd5c21798a, user.id=daeff8cc66794def963471dead837af5) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:58.765775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c585be6-c464-4a95-b0b5-d3e729c2c870 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:58.767243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c585be6-c464-4a95-b0b5-d3e729c2c870 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:58.776719 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 136/271] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:17:58 2022] GET /identity/v3/role_assignments?user.id=daeff8cc66794def963471dead837af5&scope.project.id=54174d12726547b4bb37d9dd5c21798a&role.id=dd27845a836a4f6ebece149dbebc59c0 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:17:58.829783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57b055-c4fd-458c-8e52-a59db06deaf5 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:58.830112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57b055-c4fd-458c-8e52-a59db06deaf5 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:58.830336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57b055-c4fd-458c-8e52-a59db06deaf5 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:58.832064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 136/272] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:58.848973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccf0e7-eb65-4343-b942-e5698e02e9e0 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:58.849289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccf0e7-eb65-4343-b942-e5698e02e9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:58.849525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccf0e7-eb65-4343-b942-e5698e02e9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:58.873947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-a3ccf0e7-eb65-4343-b942-e5698e02e9e0 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:58.875236 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a3ccf0e7-eb65-4343-b942-e5698e02e9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:58.950128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:58.965018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 137/273] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:59.071719 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaecb2e-45ab-4a26-a0e6-1068111284c9 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:59.071996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaecb2e-45ab-4a26-a0e6-1068111284c9 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:59.072266 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaecb2e-45ab-4a26-a0e6-1068111284c9 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:59.074167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 137/274] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:17:59.079759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8f52d-4b12-437f-a3f5-3e8d943f4580 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:59.080144 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8f52d-4b12-437f-a3f5-3e8d943f4580 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:59.080515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8f52d-4b12-437f-a3f5-3e8d943f4580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:59.100750 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-bab8f52d-4b12-437f-a3f5-3e8d943f4580 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:17:59.101934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-bab8f52d-4b12-437f-a3f5-3e8d943f4580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:17:59.177652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaecb2e-45ab-4a26-a0e6-1068111284c9 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:59.185866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 138/275] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:17:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:17:59.278016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8f52d-4b12-437f-a3f5-3e8d943f4580 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:59.315311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaecb2e-45ab-4a26-a0e6-1068111284c9 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:59.350198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:59.357593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f978e5-727b-4eeb-a368-92a4ef8c8c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:59.358231 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f978e5-727b-4eeb-a368-92a4ef8c8c91 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:59.358504 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f978e5-727b-4eeb-a368-92a4ef8c8c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:59.358773 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f978e5-727b-4eeb-a368-92a4ef8c8c91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:59.372648 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f978e5-727b-4eeb-a368-92a4ef8c8c91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:59.379781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-92f978e5-727b-4eeb-a368-92a4ef8c8c91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:17:59.379781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:59.379781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:59.379781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:59.379781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:59.379781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:59.379781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:59.379781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:59.379781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:59.379781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:59.379781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:59.379781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:59.379781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:59.379781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:59.379781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:59.379781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:59.380661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:59.380661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:59.380661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:59.380661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:59.380661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:59.380661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:59.380661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:59.380661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:59.380661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:59.380661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:59.380661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:59.380661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:59.380661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:59.380661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:59.380661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:59.380661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:59.381568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:59.381568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:59.381568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:59.381568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:59.381568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:59.381568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:59.381568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:59.381568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:59.381568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:59.381568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:59.381568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:17:59.381568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:17:59.381568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 138/276] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:17:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:17:59.386703 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f978e5-727b-4eeb-a368-92a4ef8c8c91 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:59.415293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8f52d-4b12-437f-a3f5-3e8d943f4580 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:59.453656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:59.472631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fc132-11ea-4d2d-863b-73de9689ee9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:59.472631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fc132-11ea-4d2d-863b-73de9689ee9d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:59.472906 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fc132-11ea-4d2d-863b-73de9689ee9d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:59.473128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fc132-11ea-4d2d-863b-73de9689ee9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:59.475455 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0fc132-11ea-4d2d-863b-73de9689ee9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:59.476896 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0fc132-11ea-4d2d-863b-73de9689ee9d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:59.482986 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 139/277] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:17:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:17:59.484852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fc132-11ea-4d2d-863b-73de9689ee9d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:59.522807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f978e5-727b-4eeb-a368-92a4ef8c8c91 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:59.564855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88e353-ddcb-4432-9f9c-1791d1320ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:59.565389 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88e353-ddcb-4432-9f9c-1791d1320ddc None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:59.565662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88e353-ddcb-4432-9f9c-1791d1320ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:59.565934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88e353-ddcb-4432-9f9c-1791d1320ddc None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:59.566586 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88e353-ddcb-4432-9f9c-1791d1320ddc None admin] RBAC: Adding query filter params (name=member) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:59.566907 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88e353-ddcb-4432-9f9c-1791d1320ddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:59.568297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88e353-ddcb-4432-9f9c-1791d1320ddc None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:59.577319 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 139/278] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:17:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:59.582887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88e353-ddcb-4432-9f9c-1791d1320ddc None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:59.606738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fc132-11ea-4d2d-863b-73de9689ee9d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:59.641559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:59.642814 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd29aa-4b54-4a29-8b23-52d34d14a807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:59.643450 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd29aa-4b54-4a29-8b23-52d34d14a807 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:59.643801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd29aa-4b54-4a29-8b23-52d34d14a807 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:59.644114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd29aa-4b54-4a29-8b23-52d34d14a807 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:59.644883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd29aa-4b54-4a29-8b23-52d34d14a807 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:59.646416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd29aa-4b54-4a29-8b23-52d34d14a807 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:59.668880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 140/279] 10.222.0.25 () {60 vars in 1132 bytes} [Sat Sep 24 19:17:59 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:17:59.670002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd29aa-4b54-4a29-8b23-52d34d14a807 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:59.720169 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88e353-ddcb-4432-9f9c-1791d1320ddc None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:59.738460 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:59.777115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76870895-bd68-4e1e-9c95-fdd31489541e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:59.777774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76870895-bd68-4e1e-9c95-fdd31489541e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:59.778054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76870895-bd68-4e1e-9c95-fdd31489541e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:59.778329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76870895-bd68-4e1e-9c95-fdd31489541e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:59.796476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76870895-bd68-4e1e-9c95-fdd31489541e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:17:59.802564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-76870895-bd68-4e1e-9c95-fdd31489541e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:17:59.802564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:17:59.802564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:17:59.802564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:17:59.802564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:17:59.802564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:17:59.802564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:17:59.802564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:17:59.802564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:17:59.802564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:17:59.802564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:17:59.802564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:17:59.802564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:17:59.802564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:17:59.802564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:17:59.802564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:17:59.803562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:17:59.803562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:17:59.803562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:17:59.803562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:17:59.803562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:17:59.803562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:17:59.803562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:17:59.803562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:17:59.803562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:17:59.803562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:17:59.803562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:17:59.803562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:17:59.803562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:17:59.803562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:17:59.803562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:17:59.803562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:17:59.804384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:17:59.804384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:17:59.804384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:17:59.804384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:17:59.804384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:17:59.804384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:17:59.804384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:17:59.804384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:17:59.804384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:17:59.804384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:17:59.804384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:17:59.804384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:17:59.812360 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 140/280] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:17:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:17:59.814272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76870895-bd68-4e1e-9c95-fdd31489541e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:59.815565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd29aa-4b54-4a29-8b23-52d34d14a807 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:59.867361 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359b190-bcb8-410d-b43c-df8e3ee32273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:59.868013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359b190-bcb8-410d-b43c-df8e3ee32273 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:59.868295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359b190-bcb8-410d-b43c-df8e3ee32273 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:59.868572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359b190-bcb8-410d-b43c-df8e3ee32273 None admin] PATH_INFO: `/v3/users/6c9546f2410e4c56b88de85fb4f1f5d5` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:59.889025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359b190-bcb8-410d-b43c-df8e3ee32273 None admin] RBAC: Authorizing `identity:get_user(user_id=6c9546f2410e4c56b88de85fb4f1f5d5)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:59.889975 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359b190-bcb8-410d-b43c-df8e3ee32273 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:17:59.892521 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 141/281] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:17:59 2022] GET /identity/v3/users/6c9546f2410e4c56b88de85fb4f1f5d5 => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:17:59.898072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359b190-bcb8-410d-b43c-df8e3ee32273 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:17:59.944248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76870895-bd68-4e1e-9c95-fdd31489541e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:17:59.961943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:17:59.993907 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00eb47-19d8-4f5c-b084-5763ecd27d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:17:59.994523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00eb47-19d8-4f5c-b084-5763ecd27d36 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:17:59.994801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00eb47-19d8-4f5c-b084-5763ecd27d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:17:59.995126 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00eb47-19d8-4f5c-b084-5763ecd27d36 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:17:59.996011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00eb47-19d8-4f5c-b084-5763ecd27d36 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:17:59.996423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00eb47-19d8-4f5c-b084-5763ecd27d36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:17:59.997930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00eb47-19d8-4f5c-b084-5763ecd27d36 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:00.007844 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 141/282] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:17:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:00.016928 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00eb47-19d8-4f5c-b084-5763ecd27d36 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:00.031857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359b190-bcb8-410d-b43c-df8e3ee32273 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:00.035907 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:00.076832 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca1f15-184a-4124-8858-6aaef24562ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:00.077361 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca1f15-184a-4124-8858-6aaef24562ba None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:00.077638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca1f15-184a-4124-8858-6aaef24562ba None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:00.077905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca1f15-184a-4124-8858-6aaef24562ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:00.078747 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca1f15-184a-4124-8858-6aaef24562ba None admin] RBAC: Adding query filter params (role.id=ef0525432e044dd18b3ae4b32d29030e, user.id=6c9546f2410e4c56b88de85fb4f1f5d5, scope.system=all) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:00.079086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca1f15-184a-4124-8858-6aaef24562ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:00.080634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca1f15-184a-4124-8858-6aaef24562ba None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:00.088401 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 142/283] 10.222.0.25 () {56 vars in 1308 bytes} [Sat Sep 24 19:17:59 2022] GET /identity/v3/role_assignments?user.id=6c9546f2410e4c56b88de85fb4f1f5d5&scope.system=all&role.id=ef0525432e044dd18b3ae4b32d29030e => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:00.143743 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00eb47-19d8-4f5c-b084-5763ecd27d36 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:00.187820 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a369b95-bcda-4856-b655-01c4c43a54f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:00.188583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a369b95-bcda-4856-b655-01c4c43a54f3 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:00.188760 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a369b95-bcda-4856-b655-01c4c43a54f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:00.189033 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a369b95-bcda-4856-b655-01c4c43a54f3 None admin] PATH_INFO: `/v3/users/82f06ce7c247433d878a8419f2cb8150` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:00.190320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a369b95-bcda-4856-b655-01c4c43a54f3 None admin] RBAC: Authorizing `identity:get_user(user_id=82f06ce7c247433d878a8419f2cb8150)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:00.191914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a369b95-bcda-4856-b655-01c4c43a54f3 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:00.194041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 142/284] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:18:00 2022] GET /identity/v3/users/82f06ce7c247433d878a8419f2cb8150 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:00.199989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca1f15-184a-4124-8858-6aaef24562ba None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:00.350607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca1f15-184a-4124-8858-6aaef24562ba None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:00.391262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761a96d-fc60-40ea-b9a6-b26c754c82fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:00.391900 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761a96d-fc60-40ea-b9a6-b26c754c82fb None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:00.392179 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761a96d-fc60-40ea-b9a6-b26c754c82fb None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:00.392449 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761a96d-fc60-40ea-b9a6-b26c754c82fb None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:00.393581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761a96d-fc60-40ea-b9a6-b26c754c82fb None admin] RBAC: Authorizing `identity:get_project(project_id=54174d12726547b4bb37d9dd5c21798a)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:00.395156 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761a96d-fc60-40ea-b9a6-b26c754c82fb None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:00.395965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53a89c-3a42-47da-979c-3be7afec136d None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:00.396451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53a89c-3a42-47da-979c-3be7afec136d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:00.396919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53a89c-3a42-47da-979c-3be7afec136d None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:00.397107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 143/285] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:18:00 2022] GET /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:00.399169 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 143/286] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:00.405204 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761a96d-fc60-40ea-b9a6-b26c754c82fb None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:00.405944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf53b8-cc89-412f-b8a9-b2c357e042e4 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:00.406430 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf53b8-cc89-412f-b8a9-b2c357e042e4 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:00.406944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf53b8-cc89-412f-b8a9-b2c357e042e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:00.451983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-59cf53b8-cc89-412f-b8a9-b2c357e042e4 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:00.453212 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-59cf53b8-cc89-412f-b8a9-b2c357e042e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:00.455394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:00.523048 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761a96d-fc60-40ea-b9a6-b26c754c82fb None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:00.534974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:00.574782 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b1005-eeda-4246-993c-4a8f9319e165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:00.575470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b1005-eeda-4246-993c-4a8f9319e165 None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:00.575749 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b1005-eeda-4246-993c-4a8f9319e165 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:00.576020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b1005-eeda-4246-993c-4a8f9319e165 None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a/users/82f06ce7c247433d878a8419f2cb8150/roles/4b618f407f654e32a6a29da3aa4f83e2` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:00.579431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b1005-eeda-4246-993c-4a8f9319e165 None admin] RBAC: Authorizing `identity:create_grant(project_id=54174d12726547b4bb37d9dd5c21798a, user_id=82f06ce7c247433d878a8419f2cb8150, role_id=4b618f407f654e32a6a29da3aa4f83e2)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:00.580870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b1005-eeda-4246-993c-4a8f9319e165 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:00.591957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 144/287] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:18:00.604243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 144/288] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:18:00 2022] PUT /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a/users/82f06ce7c247433d878a8419f2cb8150/roles/4b618f407f654e32a6a29da3aa4f83e2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:18:00.955125 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf53b8-cc89-412f-b8a9-b2c357e042e4 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:01.083848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf53b8-cc89-412f-b8a9-b2c357e042e4 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:01.131834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f3f4c-306e-4ba2-b6fb-6852ff66430d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:01.132477 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f3f4c-306e-4ba2-b6fb-6852ff66430d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:01.132757 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f3f4c-306e-4ba2-b6fb-6852ff66430d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:01.133028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f3f4c-306e-4ba2-b6fb-6852ff66430d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:01.148222 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f3f4c-306e-4ba2-b6fb-6852ff66430d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:01.153744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-d64f3f4c-306e-4ba2-b6fb-6852ff66430d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:18:01.153744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:01.153744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:01.153744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:01.153744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:01.153744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:01.153744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:01.153744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:01.153744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:01.153744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:01.153744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:01.153744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:01.153744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:01.153744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:01.153744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:01.153744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:01.154645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:01.154645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:01.154645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:01.154645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:01.154645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:01.154645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:01.154645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:01.154645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:01.154645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:01.154645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:01.154645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:01.154645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:01.154645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:01.154645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:01.154645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:01.154645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:01.155543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:01.155543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:01.155543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:01.155543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:01.155543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:01.155543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:01.155543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:01.155543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:01.155543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:01.155543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:01.155543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:18:01.155543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:01.155543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 145/289] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:01.163967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b1005-eeda-4246-993c-4a8f9319e165 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:01.297541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:01.303797 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b1005-eeda-4246-993c-4a8f9319e165 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:01.348867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ce1f6-9336-4580-9428-f699f843b9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:01.349482 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ce1f6-9336-4580-9428-f699f843b9eb None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:01.349764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ce1f6-9336-4580-9428-f699f843b9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:01.350037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ce1f6-9336-4580-9428-f699f843b9eb None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:01.350697 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ce1f6-9336-4580-9428-f699f843b9eb None admin] RBAC: Adding query filter params (name=member) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:01.351024 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ce1f6-9336-4580-9428-f699f843b9eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:01.352396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ce1f6-9336-4580-9428-f699f843b9eb None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:01.363716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 145/290] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:18:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:01.369073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f3f4c-306e-4ba2-b6fb-6852ff66430d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:01.434600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:01.524165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f3f4c-306e-4ba2-b6fb-6852ff66430d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:01.573822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d4cd9-9e48-41b9-825a-2004c5503edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:01.574618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d4cd9-9e48-41b9-825a-2004c5503edc None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:01.574926 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d4cd9-9e48-41b9-825a-2004c5503edc None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:01.575204 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d4cd9-9e48-41b9-825a-2004c5503edc None admin] PATH_INFO: `/v3/users/9beba998b73a474ba7482e45028d1c8c` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:01.577314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d4cd9-9e48-41b9-825a-2004c5503edc None admin] RBAC: Authorizing `identity:get_user(user_id=9beba998b73a474ba7482e45028d1c8c)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:01.579035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d4cd9-9e48-41b9-825a-2004c5503edc None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:01.580839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 146/291] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:18:01 2022] GET /identity/v3/users/9beba998b73a474ba7482e45028d1c8c => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:01.586299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ce1f6-9336-4580-9428-f699f843b9eb None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:01.719939 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ce1f6-9336-4580-9428-f699f843b9eb None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:01.774116 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cc2c4-4aae-4a3c-ad70-c18d5f9b5764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:01.775116 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cc2c4-4aae-4a3c-ad70-c18d5f9b5764 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:01.775595 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cc2c4-4aae-4a3c-ad70-c18d5f9b5764 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:01.776086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cc2c4-4aae-4a3c-ad70-c18d5f9b5764 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:01.815871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:01.870360 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41cc2c4-4aae-4a3c-ad70-c18d5f9b5764 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:01.872248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41cc2c4-4aae-4a3c-ad70-c18d5f9b5764 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:02.003858 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 146/292] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:18:02.009411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d4cd9-9e48-41b9-825a-2004c5503edc None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:02.139178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d4cd9-9e48-41b9-825a-2004c5503edc None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:02.140782 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:02.180615 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfe256-eaa8-46b5-ac15-d7cb199b4db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:02.181250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfe256-eaa8-46b5-ac15-d7cb199b4db0 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:02.181529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfe256-eaa8-46b5-ac15-d7cb199b4db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:02.181801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfe256-eaa8-46b5-ac15-d7cb199b4db0 None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:02.183145 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfe256-eaa8-46b5-ac15-d7cb199b4db0 None admin] RBAC: Authorizing `identity:get_project(project_id=54174d12726547b4bb37d9dd5c21798a)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:02.184673 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfe256-eaa8-46b5-ac15-d7cb199b4db0 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:02.186694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 147/293] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:18:02 2022] GET /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:02.192148 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cc2c4-4aae-4a3c-ad70-c18d5f9b5764 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:02.298099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:02.351937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cc2c4-4aae-4a3c-ad70-c18d5f9b5764 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:02.404957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d514286-4c7b-4444-bff4-566bb0061153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:02.405887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d514286-4c7b-4444-bff4-566bb0061153 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:02.406364 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d514286-4c7b-4444-bff4-566bb0061153 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:02.406870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d514286-4c7b-4444-bff4-566bb0061153 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:02.407784 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d514286-4c7b-4444-bff4-566bb0061153 None admin] RBAC: Adding query filter params (role.id=ef0525432e044dd18b3ae4b32d29030e, scope.project.id=54174d12726547b4bb37d9dd5c21798a, user.id=9beba998b73a474ba7482e45028d1c8c) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:02.408310 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d514286-4c7b-4444-bff4-566bb0061153 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:02.409945 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d514286-4c7b-4444-bff4-566bb0061153 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:02.419835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 147/294] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:18:02 2022] GET /identity/v3/role_assignments?user.id=9beba998b73a474ba7482e45028d1c8c&scope.project.id=54174d12726547b4bb37d9dd5c21798a&role.id=ef0525432e044dd18b3ae4b32d29030e => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:02.424483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592e838-e04b-498c-af00-cba758d22262 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:02.424901 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592e838-e04b-498c-af00-cba758d22262 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:02.425042 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592e838-e04b-498c-af00-cba758d22262 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:02.428251 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 148/295] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:02.433666 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd1321-8b1b-469e-be20-c8d8346be3aa None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:02.434197 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd1321-8b1b-469e-be20-c8d8346be3aa None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:02.434651 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd1321-8b1b-469e-be20-c8d8346be3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:02.467648 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-f7cd1321-8b1b-469e-be20-c8d8346be3aa None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:02.469216 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f7cd1321-8b1b-469e-be20-c8d8346be3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:02.569589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 148/296] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:02.769146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60897312-6c36-4740-af6c-e34c452cab2a None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:02.769826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60897312-6c36-4740-af6c-e34c452cab2a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:02.770374 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60897312-6c36-4740-af6c-e34c452cab2a None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:02.771955 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 149/297] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:02.777469 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e23313-fcbb-45e2-8f9c-9fa4a9febd2b None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:02.777761 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e23313-fcbb-45e2-8f9c-9fa4a9febd2b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:02.778039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e23313-fcbb-45e2-8f9c-9fa4a9febd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:02.800300 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-41e23313-fcbb-45e2-8f9c-9fa4a9febd2b None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:02.801500 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-41e23313-fcbb-45e2-8f9c-9fa4a9febd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:02.858254 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:02.882047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 149/298] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:02.904140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60897312-6c36-4740-af6c-e34c452cab2a None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:03.012282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ec4c2-7978-4fbd-9bb0-0d51d877197e None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:03.012561 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ec4c2-7978-4fbd-9bb0-0d51d877197e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:03.012828 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ec4c2-7978-4fbd-9bb0-0d51d877197e None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:03.014315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 150/299] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:03.020596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665c0a1-6969-4646-921f-1d90b4d591ca None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:03.020817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665c0a1-6969-4646-921f-1d90b4d591ca None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:03.021081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665c0a1-6969-4646-921f-1d90b4d591ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:03.040725 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60897312-6c36-4740-af6c-e34c452cab2a None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:03.045473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-5665c0a1-6969-4646-921f-1d90b4d591ca None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:03.046962 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5665c0a1-6969-4646-921f-1d90b4d591ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:03.086472 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34049a97-867d-42ba-ad70-fa9965426a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:03.087186 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34049a97-867d-42ba-ad70-fa9965426a85 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:03.087434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34049a97-867d-42ba-ad70-fa9965426a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:03.087710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34049a97-867d-42ba-ad70-fa9965426a85 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:03.102558 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34049a97-867d-42ba-ad70-fa9965426a85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:03.110474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-34049a97-867d-42ba-ad70-fa9965426a85 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:18:03.110474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:03.110474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:03.110474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:03.110474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:03.110474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:03.110474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:03.110474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:03.110474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:03.110474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:03.110474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:03.110474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:03.110474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:03.110474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:03.110474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:03.110474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:03.111438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:03.111438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:03.111438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:03.111438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:03.111438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:03.111438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:03.111438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:03.111438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:03.111438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:03.111438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:03.111438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:03.111438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:03.111438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:03.111438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:03.111438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:03.111438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:03.112228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:03.112228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:03.112228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:03.112228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:03.112228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:03.112228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:03.112228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:03.112228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:03.112228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:03.112228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:03.112228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:18:03.112228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:03.112228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 150/300] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:03.118332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34049a97-867d-42ba-ad70-fa9965426a85 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:03.140249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 151/301] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:18:03.157695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:03.203031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665c0a1-6969-4646-921f-1d90b4d591ca None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:03.239884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34049a97-867d-42ba-ad70-fa9965426a85 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:03.292219 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1bbaf-4aed-4612-a0fe-aa85b9930b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:03.293124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1bbaf-4aed-4612-a0fe-aa85b9930b3c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:03.293405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1bbaf-4aed-4612-a0fe-aa85b9930b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:03.293675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1bbaf-4aed-4612-a0fe-aa85b9930b3c None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:03.294809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1bbaf-4aed-4612-a0fe-aa85b9930b3c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:03.295137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1bbaf-4aed-4612-a0fe-aa85b9930b3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:03.296943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1bbaf-4aed-4612-a0fe-aa85b9930b3c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:03.306812 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 151/302] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:18:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:03.313335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1bbaf-4aed-4612-a0fe-aa85b9930b3c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:03.324494 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665c0a1-6969-4646-921f-1d90b4d591ca None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:03.339954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:03.363996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e609af-bb49-43a6-9a55-2c72dc88491a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:03.364724 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e609af-bb49-43a6-9a55-2c72dc88491a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:03.365046 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e609af-bb49-43a6-9a55-2c72dc88491a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:03.365324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e609af-bb49-43a6-9a55-2c72dc88491a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:03.378489 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e609af-bb49-43a6-9a55-2c72dc88491a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:03.383336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-f6e609af-bb49-43a6-9a55-2c72dc88491a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:18:03.383336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:03.383336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:03.383336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:03.383336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:03.383336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:03.383336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:03.383336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:03.383336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:03.383336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:03.383336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:03.383336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:03.383336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:03.383336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:03.383336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:03.383336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:03.384272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:03.384272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:03.384272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:03.384272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:03.384272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:03.384272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:03.384272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:03.384272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:03.384272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:03.384272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:03.384272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:03.384272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:03.384272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:03.384272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:03.384272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:03.384272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:03.385921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:03.385921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:03.385921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:03.385921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:03.385921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:03.385921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:03.385921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:03.385921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:03.385921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:03.385921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:03.385921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:18:03.385921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:03.385921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 152/303] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:03.388585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc65c9-74bf-4d18-a3a9-1c787b6ab18d None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:03.388864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc65c9-74bf-4d18-a3a9-1c787b6ab18d None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:03.389133 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc65c9-74bf-4d18-a3a9-1c787b6ab18d None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:03.390416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 153/304] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:03.391120 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc65c9-74bf-4d18-a3a9-1c787b6ab18d None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:03.424897 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:03.437153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1bbaf-4aed-4612-a0fe-aa85b9930b3c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:03.473578 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ff4fc-079f-413b-960b-7f4e4e521b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:03.474207 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ff4fc-079f-413b-960b-7f4e4e521b6a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:03.474492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ff4fc-079f-413b-960b-7f4e4e521b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:03.474764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ff4fc-079f-413b-960b-7f4e4e521b6a None admin] PATH_INFO: `/v3/users/b475625a149c41449e3c35c4f0db0536` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:03.488257 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ff4fc-079f-413b-960b-7f4e4e521b6a None admin] RBAC: Authorizing `identity:get_user(user_id=b475625a149c41449e3c35c4f0db0536)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:03.489744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ff4fc-079f-413b-960b-7f4e4e521b6a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:03.491374 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 152/305] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:18:03 2022] GET /identity/v3/users/b475625a149c41449e3c35c4f0db0536 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:03.492497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd1dd7-13de-4aa4-ab46-8be07b13c8d3 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:03.492775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd1dd7-13de-4aa4-ab46-8be07b13c8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:03.493047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd1dd7-13de-4aa4-ab46-8be07b13c8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:03.505054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc65c9-74bf-4d18-a3a9-1c787b6ab18d None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:03.511499 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-adcd1dd7-13de-4aa4-ab46-8be07b13c8d3 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:03.512634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-adcd1dd7-13de-4aa4-ab46-8be07b13c8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:03.538331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372be7cb-ff9b-453d-958c-ff0643399ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:03.538959 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372be7cb-ff9b-453d-958c-ff0643399ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:03.539238 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372be7cb-ff9b-453d-958c-ff0643399ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:03.539508 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372be7cb-ff9b-453d-958c-ff0643399ae8 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:03.540157 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372be7cb-ff9b-453d-958c-ff0643399ae8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:03.540455 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372be7cb-ff9b-453d-958c-ff0643399ae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:03.541831 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372be7cb-ff9b-453d-958c-ff0643399ae8 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:03.550907 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 154/306] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:18:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:03.555408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372be7cb-ff9b-453d-958c-ff0643399ae8 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:03.578326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 153/307] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:03.579199 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd1dd7-13de-4aa4-ab46-8be07b13c8d3 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:03.590261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:03.662580 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:03.663904 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372be7cb-ff9b-453d-958c-ff0643399ae8 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:03.683803 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd1dd7-13de-4aa4-ab46-8be07b13c8d3 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:03.702191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f679f43-3f54-4c7e-8ab1-f10e6a9e685e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:03.703016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f679f43-3f54-4c7e-8ab1-f10e6a9e685e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:03.703303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f679f43-3f54-4c7e-8ab1-f10e6a9e685e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:03.703575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f679f43-3f54-4c7e-8ab1-f10e6a9e685e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:03.704820 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f679f43-3f54-4c7e-8ab1-f10e6a9e685e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:03.706125 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f679f43-3f54-4c7e-8ab1-f10e6a9e685e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:03.711259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 155/308] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:03.711259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f679f43-3f54-4c7e-8ab1-f10e6a9e685e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:03.723067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae806f-e1e3-47ee-91db-298e73ab1c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:03.723885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae806f-e1e3-47ee-91db-298e73ab1c5e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:03.724167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae806f-e1e3-47ee-91db-298e73ab1c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:03.724436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae806f-e1e3-47ee-91db-298e73ab1c5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:03.725158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae806f-e1e3-47ee-91db-298e73ab1c5e None admin] RBAC: Adding query filter params (role.id=4b618f407f654e32a6a29da3aa4f83e2, user.id=b475625a149c41449e3c35c4f0db0536, scope.system=all) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:03.725470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae806f-e1e3-47ee-91db-298e73ab1c5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:03.726936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae806f-e1e3-47ee-91db-298e73ab1c5e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:03.732121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 154/309] 10.222.0.25 () {56 vars in 1308 bytes} [Sat Sep 24 19:18:03 2022] GET /identity/v3/role_assignments?user.id=b475625a149c41449e3c35c4f0db0536&scope.system=all&role.id=4b618f407f654e32a6a29da3aa4f83e2 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:03.732870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae806f-e1e3-47ee-91db-298e73ab1c5e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:03.851887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f679f43-3f54-4c7e-8ab1-f10e6a9e685e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:03.853639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:03.873952 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae806f-e1e3-47ee-91db-298e73ab1c5e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:03.891662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af1a65-3976-4e4e-92e1-6f8857bbce61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:03.892213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af1a65-3976-4e4e-92e1-6f8857bbce61 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:03.892490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af1a65-3976-4e4e-92e1-6f8857bbce61 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:03.892768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af1a65-3976-4e4e-92e1-6f8857bbce61 None admin] PATH_INFO: `/v3/users/6c9546f2410e4c56b88de85fb4f1f5d5` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:03.894001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af1a65-3976-4e4e-92e1-6f8857bbce61 None admin] RBAC: Authorizing `identity:get_user(user_id=6c9546f2410e4c56b88de85fb4f1f5d5)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:03.895564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af1a65-3976-4e4e-92e1-6f8857bbce61 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:03.902885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 156/310] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:18:03 2022] GET /identity/v3/users/6c9546f2410e4c56b88de85fb4f1f5d5 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:03.902885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af1a65-3976-4e4e-92e1-6f8857bbce61 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:03.918768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a4767-f915-4114-be7d-d421056814b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:03.919419 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a4767-f915-4114-be7d-d421056814b9 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:03.919700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a4767-f915-4114-be7d-d421056814b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:03.919974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a4767-f915-4114-be7d-d421056814b9 None admin] PATH_INFO: `/v3/groups` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:03.920605 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a4767-f915-4114-be7d-d421056814b9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:03.922047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a4767-f915-4114-be7d-d421056814b9 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:03.946119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 155/311] 10.222.0.25 () {60 vars in 1134 bytes} [Sat Sep 24 19:18:03 2022] POST /identity/v3/groups => generated 229 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:18:03.946119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a4767-f915-4114-be7d-d421056814b9 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:03.953860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:04.036973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af1a65-3976-4e4e-92e1-6f8857bbce61 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:04.077762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a4767-f915-4114-be7d-d421056814b9 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:04.079199 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1a5ce-882a-461f-80cb-b76cbe14c4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:04.079971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1a5ce-882a-461f-80cb-b76cbe14c4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:04.080349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1a5ce-882a-461f-80cb-b76cbe14c4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:04.080717 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1a5ce-882a-461f-80cb-b76cbe14c4c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:04.092938 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1a5ce-882a-461f-80cb-b76cbe14c4c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:04.098772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-33b1a5ce-882a-461f-80cb-b76cbe14c4c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:18:04.098772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:04.098772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:04.098772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:04.098772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:04.098772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:04.098772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:04.098772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:04.098772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:04.098772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:04.098772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:04.098772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:04.098772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:04.098772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:04.098772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:04.098772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:04.099875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:04.099875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:04.099875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:04.099875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:04.099875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:04.099875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:04.099875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:04.099875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:04.099875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:04.099875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:04.099875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:04.099875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:04.099875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:04.099875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:04.099875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:04.099875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:04.100695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:04.100695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:04.100695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:04.100695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:04.100695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:04.100695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:04.100695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:04.100695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:04.100695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:04.100695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:04.100695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:18:04.100695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:04.101319 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 157/312] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:04.106973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1a5ce-882a-461f-80cb-b76cbe14c4c5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:04.132491 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326b751-93d9-437b-b8e4-d8e9faa34161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:04.133306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326b751-93d9-437b-b8e4-d8e9faa34161 None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:04.134002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326b751-93d9-437b-b8e4-d8e9faa34161 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:04.134378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326b751-93d9-437b-b8e4-d8e9faa34161 None admin] PATH_INFO: `/v3/system/users/6c9546f2410e4c56b88de85fb4f1f5d5/roles/ef0525432e044dd18b3ae4b32d29030e` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:04.137268 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326b751-93d9-437b-b8e4-d8e9faa34161 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6c9546f2410e4c56b88de85fb4f1f5d5, role_id=ef0525432e044dd18b3ae4b32d29030e)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:04.138790 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326b751-93d9-437b-b8e4-d8e9faa34161 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:04.143555 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:04.154716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 156/313] 10.222.0.25 () {58 vars in 1334 bytes} [Sat Sep 24 19:18:03 2022] PUT /identity/v3/system/users/6c9546f2410e4c56b88de85fb4f1f5d5/roles/ef0525432e044dd18b3ae4b32d29030e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:18:04.231059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1a5ce-882a-461f-80cb-b76cbe14c4c5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:04.272396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25274392-df35-446a-ba13-b3f56ee15928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:04.273433 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25274392-df35-446a-ba13-b3f56ee15928 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:04.274244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25274392-df35-446a-ba13-b3f56ee15928 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:04.274709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25274392-df35-446a-ba13-b3f56ee15928 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:04.275677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25274392-df35-446a-ba13-b3f56ee15928 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:04.276187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25274392-df35-446a-ba13-b3f56ee15928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:04.278134 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25274392-df35-446a-ba13-b3f56ee15928 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:04.289174 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 158/314] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:18:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:04.296470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326b751-93d9-437b-b8e4-d8e9faa34161 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:04.373772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:04.410385 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326b751-93d9-437b-b8e4-d8e9faa34161 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:04.457234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6ead0-93b3-4b2d-b017-949d787d78c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:04.457895 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6ead0-93b3-4b2d-b017-949d787d78c6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:04.458143 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6ead0-93b3-4b2d-b017-949d787d78c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:04.458469 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6ead0-93b3-4b2d-b017-949d787d78c6 None admin] PATH_INFO: `/v3/users/82f06ce7c247433d878a8419f2cb8150` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:04.459643 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6ead0-93b3-4b2d-b017-949d787d78c6 None admin] RBAC: Authorizing `identity:get_user(user_id=82f06ce7c247433d878a8419f2cb8150)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:04.461092 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6ead0-93b3-4b2d-b017-949d787d78c6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:04.463031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 157/315] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:18:04 2022] GET /identity/v3/users/82f06ce7c247433d878a8419f2cb8150 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:04.472164 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25274392-df35-446a-ba13-b3f56ee15928 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:04.576697 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:04.587148 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25274392-df35-446a-ba13-b3f56ee15928 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:04.623689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8a02e-590b-4105-a847-95a9e38fa183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:04.624356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8a02e-590b-4105-a847-95a9e38fa183 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:04.624579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8a02e-590b-4105-a847-95a9e38fa183 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:04.624852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8a02e-590b-4105-a847-95a9e38fa183 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:04.697412 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8a02e-590b-4105-a847-95a9e38fa183 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:04.699011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8a02e-590b-4105-a847-95a9e38fa183 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:04.799803 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 159/316] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:18:04.800454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:04.805629 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6ead0-93b3-4b2d-b017-949d787d78c6 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:04.914989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6ead0-93b3-4b2d-b017-949d787d78c6 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:04.950434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f0079-ca07-4c87-b2d6-f186a70e7c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:04.951103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f0079-ca07-4c87-b2d6-f186a70e7c15 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:04.951384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f0079-ca07-4c87-b2d6-f186a70e7c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:04.951657 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f0079-ca07-4c87-b2d6-f186a70e7c15 None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:04.952812 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f0079-ca07-4c87-b2d6-f186a70e7c15 None admin] RBAC: Authorizing `identity:get_project(project_id=54174d12726547b4bb37d9dd5c21798a)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:04.954272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f0079-ca07-4c87-b2d6-f186a70e7c15 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:04.956267 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 158/317] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:18:04 2022] GET /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:04.962104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8a02e-590b-4105-a847-95a9e38fa183 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:05.073019 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8a02e-590b-4105-a847-95a9e38fa183 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:05.109909 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abaf09-261a-4591-83f8-fbd9e3deb60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:05.110535 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abaf09-261a-4591-83f8-fbd9e3deb60c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:05.110809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abaf09-261a-4591-83f8-fbd9e3deb60c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:05.111117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abaf09-261a-4591-83f8-fbd9e3deb60c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:05.111855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abaf09-261a-4591-83f8-fbd9e3deb60c None admin] RBAC: Adding query filter params (role.id=4b618f407f654e32a6a29da3aa4f83e2, scope.project.id=54174d12726547b4bb37d9dd5c21798a, user.id=82f06ce7c247433d878a8419f2cb8150) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:05.112156 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abaf09-261a-4591-83f8-fbd9e3deb60c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:05.113624 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abaf09-261a-4591-83f8-fbd9e3deb60c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:05.120680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 160/318] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:18:04 2022] GET /identity/v3/role_assignments?user.id=82f06ce7c247433d878a8419f2cb8150&scope.project.id=54174d12726547b4bb37d9dd5c21798a&role.id=4b618f407f654e32a6a29da3aa4f83e2 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:05.990757 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51c831-75f8-4c3b-8f07-53b78b932f32 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:05.991293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51c831-75f8-4c3b-8f07-53b78b932f32 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:05.991368 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51c831-75f8-4c3b-8f07-53b78b932f32 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:05.992791 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 159/319] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:05.998300 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b59bb-91fa-4bb0-960b-8b9c857d5a28 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:05.998720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b59bb-91fa-4bb0-960b-8b9c857d5a28 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:05.998919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b59bb-91fa-4bb0-960b-8b9c857d5a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:06.017814 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-e04b59bb-91fa-4bb0-960b-8b9c857d5a28 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:06.019018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e04b59bb-91fa-4bb0-960b-8b9c857d5a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:06.072620 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:06.094878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 161/320] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:18:06.332896 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887babc6-6435-4ae7-a5b6-5e9422cc8184 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:06.333234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887babc6-6435-4ae7-a5b6-5e9422cc8184 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:06.333409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887babc6-6435-4ae7-a5b6-5e9422cc8184 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:06.334862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 160/321] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:06.340538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a84e1-1f18-4345-a108-6576a783f838 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:06.340823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a84e1-1f18-4345-a108-6576a783f838 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:06.341095 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a84e1-1f18-4345-a108-6576a783f838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:06.359118 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-694a84e1-1f18-4345-a108-6576a783f838 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:06.360304 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-694a84e1-1f18-4345-a108-6576a783f838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:06.375362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887babc6-6435-4ae7-a5b6-5e9422cc8184 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:06.379388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:06.430877 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 162/322] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:06.431504 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128a09f-c893-4806-9156-04b75b3026da None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:06.431788 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128a09f-c893-4806-9156-04b75b3026da None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:06.432061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128a09f-c893-4806-9156-04b75b3026da None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:06.434230 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 163/323] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:06.439590 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c06138-62b5-4485-a94f-3023570fed05 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:06.439868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c06138-62b5-4485-a94f-3023570fed05 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:06.440134 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c06138-62b5-4485-a94f-3023570fed05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:06.457784 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-36c06138-62b5-4485-a94f-3023570fed05 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:06.459000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-36c06138-62b5-4485-a94f-3023570fed05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:06.493714 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887babc6-6435-4ae7-a5b6-5e9422cc8184 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:06.534449 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170b893-991a-4dd5-98c4-0bf356f24aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:06.542854 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170b893-991a-4dd5-98c4-0bf356f24aae None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:06.542990 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 164/324] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:18:06.543145 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170b893-991a-4dd5-98c4-0bf356f24aae None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:06.543145 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170b893-991a-4dd5-98c4-0bf356f24aae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:06.552389 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170b893-991a-4dd5-98c4-0bf356f24aae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:06.558292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-2170b893-991a-4dd5-98c4-0bf356f24aae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:18:06.558292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:06.558292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:06.558292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:06.558292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:06.558292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:06.558292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:06.558292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:06.558292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:06.558292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:06.558292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:06.558292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:06.558292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:06.558292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:06.558292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:06.558292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:06.559270 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:06.559270 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:06.559270 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:06.559270 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:06.559270 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:06.559270 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:06.559270 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:06.559270 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:06.559270 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:06.559270 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:06.559270 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:06.559270 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:06.559270 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:06.559270 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:06.559270 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:06.559270 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:06.560069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:06.560069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:06.560069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:06.560069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:06.560069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:06.560069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:06.560069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:06.560069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:06.560069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:06.560069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:06.560069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:18:06.560069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:06.560069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 161/325] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:06.565252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c06138-62b5-4485-a94f-3023570fed05 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:06.612463 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:06.666006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c06138-62b5-4485-a94f-3023570fed05 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:06.699228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543ae85-1328-4b0a-afb2-d792937c09e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:06.699828 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543ae85-1328-4b0a-afb2-d792937c09e0 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:06.700108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543ae85-1328-4b0a-afb2-d792937c09e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:06.700379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543ae85-1328-4b0a-afb2-d792937c09e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:06.701028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543ae85-1328-4b0a-afb2-d792937c09e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:06.701330 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543ae85-1328-4b0a-afb2-d792937c09e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:06.702701 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543ae85-1328-4b0a-afb2-d792937c09e0 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:06.704962 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170b893-991a-4dd5-98c4-0bf356f24aae None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:06.713380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 165/326] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:18:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:06.718845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543ae85-1328-4b0a-afb2-d792937c09e0 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:06.773329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:06.815603 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170b893-991a-4dd5-98c4-0bf356f24aae None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:06.824259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543ae85-1328-4b0a-afb2-d792937c09e0 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:06.832812 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:06.850426 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3472c-80c5-4067-bf94-7b41da3a2ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:06.851092 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3472c-80c5-4067-bf94-7b41da3a2ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:06.851374 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3472c-80c5-4067-bf94-7b41da3a2ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:06.851647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3472c-80c5-4067-bf94-7b41da3a2ae5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:06.852747 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3472c-80c5-4067-bf94-7b41da3a2ae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:06.854324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3472c-80c5-4067-bf94-7b41da3a2ae5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:06.855952 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 162/327] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:06.856712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3472c-80c5-4067-bf94-7b41da3a2ae5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:06.862359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89b338-4fc0-4547-8ceb-e86966c1fab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:06.863072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89b338-4fc0-4547-8ceb-e86966c1fab2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:06.863300 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89b338-4fc0-4547-8ceb-e86966c1fab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:06.863569 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89b338-4fc0-4547-8ceb-e86966c1fab2 None admin] PATH_INFO: `/v3/users/b475625a149c41449e3c35c4f0db0536` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:06.864682 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89b338-4fc0-4547-8ceb-e86966c1fab2 None admin] RBAC: Authorizing `identity:get_user(user_id=b475625a149c41449e3c35c4f0db0536)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:06.866149 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89b338-4fc0-4547-8ceb-e86966c1fab2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:06.867818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 166/328] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:18:06 2022] GET /identity/v3/users/b475625a149c41449e3c35c4f0db0536 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:06.868656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89b338-4fc0-4547-8ceb-e86966c1fab2 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:06.958161 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3472c-80c5-4067-bf94-7b41da3a2ae5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:06.966538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89b338-4fc0-4547-8ceb-e86966c1fab2 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:06.986890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:06.992584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef542943-9db4-408b-9821-ba4841e875eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:06.993213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef542943-9db4-408b-9821-ba4841e875eb None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:06.993496 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef542943-9db4-408b-9821-ba4841e875eb None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:06.993786 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef542943-9db4-408b-9821-ba4841e875eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:07.000577 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc34af-ad46-4dec-b8bc-9baba638ece7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:07.001180 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc34af-ad46-4dec-b8bc-9baba638ece7 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:07.001457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc34af-ad46-4dec-b8bc-9baba638ece7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:07.001731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc34af-ad46-4dec-b8bc-9baba638ece7 None admin] PATH_INFO: `/v3/groups` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:07.002354 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc34af-ad46-4dec-b8bc-9baba638ece7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:07.003800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc34af-ad46-4dec-b8bc-9baba638ece7 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:07.004787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef542943-9db4-408b-9821-ba4841e875eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:07.010247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-ef542943-9db4-408b-9821-ba4841e875eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:18:07.010247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:07.010247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:07.010247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:07.010247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:07.010247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:07.010247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:07.010247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:07.010247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:07.010247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:07.010247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:07.010247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:07.010247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:07.010247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:07.010247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:07.010247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:07.011662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:07.011662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:07.011662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:07.011662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:07.011662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:07.011662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:07.011662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:07.011662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:07.011662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:07.011662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:07.011662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:07.011662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:07.011662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:07.011662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:07.011662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:07.011662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:07.012473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:07.012473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:07.012473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:07.012473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:07.012473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:07.012473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:07.012473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:07.012473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:07.012473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:07.012473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:07.012473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:18:07.012473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:07.012473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 163/329] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:07.012473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef542943-9db4-408b-9821-ba4841e875eb None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:07.026859 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 167/330] 10.222.0.25 () {60 vars in 1134 bytes} [Sat Sep 24 19:18:06 2022] POST /identity/v3/groups => generated 226 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:18:07.026859 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc34af-ad46-4dec-b8bc-9baba638ece7 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:07.072915 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:07.143013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef542943-9db4-408b-9821-ba4841e875eb None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:07.150380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc34af-ad46-4dec-b8bc-9baba638ece7 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:07.181447 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee86cb3-b60b-4579-b35e-67d0ee87c836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:07.182111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee86cb3-b60b-4579-b35e-67d0ee87c836 None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:07.182386 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee86cb3-b60b-4579-b35e-67d0ee87c836 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:07.183238 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee86cb3-b60b-4579-b35e-67d0ee87c836 None admin] PATH_INFO: `/v3/system/users/b475625a149c41449e3c35c4f0db0536/roles/4b618f407f654e32a6a29da3aa4f83e2` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:07.185186 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee86cb3-b60b-4579-b35e-67d0ee87c836 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b475625a149c41449e3c35c4f0db0536, role_id=4b618f407f654e32a6a29da3aa4f83e2)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:07.186597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee86cb3-b60b-4579-b35e-67d0ee87c836 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:07.194097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 164/331] 10.222.0.25 () {58 vars in 1334 bytes} [Sat Sep 24 19:18:07 2022] PUT /identity/v3/system/users/b475625a149c41449e3c35c4f0db0536/roles/4b618f407f654e32a6a29da3aa4f83e2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:18:07.195569 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a7803-9380-49d3-a4af-f58fd03cb700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:07.196191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a7803-9380-49d3-a4af-f58fd03cb700 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:07.196472 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a7803-9380-49d3-a4af-f58fd03cb700 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:07.196751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a7803-9380-49d3-a4af-f58fd03cb700 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:07.197477 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a7803-9380-49d3-a4af-f58fd03cb700 None admin] RBAC: Adding query filter params (name=member) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:07.197787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a7803-9380-49d3-a4af-f58fd03cb700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:07.199631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a7803-9380-49d3-a4af-f58fd03cb700 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:07.209882 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 168/332] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:18:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:07.216655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee86cb3-b60b-4579-b35e-67d0ee87c836 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:07.286805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:07.340230 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee86cb3-b60b-4579-b35e-67d0ee87c836 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:07.379454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bdf9d-7a13-4ecd-a600-fb2fd3c5094b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:07.380327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bdf9d-7a13-4ecd-a600-fb2fd3c5094b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:07.380744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bdf9d-7a13-4ecd-a600-fb2fd3c5094b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:07.381155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bdf9d-7a13-4ecd-a600-fb2fd3c5094b None admin] PATH_INFO: `/v3/users/6c9546f2410e4c56b88de85fb4f1f5d5` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:07.382519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bdf9d-7a13-4ecd-a600-fb2fd3c5094b None admin] RBAC: Authorizing `identity:get_user(user_id=6c9546f2410e4c56b88de85fb4f1f5d5)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:07.384075 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bdf9d-7a13-4ecd-a600-fb2fd3c5094b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:07.386527 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 165/333] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:18:07 2022] GET /identity/v3/users/6c9546f2410e4c56b88de85fb4f1f5d5 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:07.392140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a7803-9380-49d3-a4af-f58fd03cb700 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:07.493524 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:07.500587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a7803-9380-49d3-a4af-f58fd03cb700 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:07.540406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0209bb-1682-4657-9cfe-b65f719392b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:07.541015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0209bb-1682-4657-9cfe-b65f719392b3 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:07.541294 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0209bb-1682-4657-9cfe-b65f719392b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:07.541559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0209bb-1682-4657-9cfe-b65f719392b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:07.542987 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0209bb-1682-4657-9cfe-b65f719392b3 None admin] RBAC: Adding query filter params (role.id=ef0525432e044dd18b3ae4b32d29030e, user.id=6c9546f2410e4c56b88de85fb4f1f5d5, scope.system=all) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:07.543566 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0209bb-1682-4657-9cfe-b65f719392b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:07.545214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0209bb-1682-4657-9cfe-b65f719392b3 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:07.558636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 169/334] 10.222.0.25 () {56 vars in 1308 bytes} [Sat Sep 24 19:18:07 2022] GET /identity/v3/role_assignments?user.id=6c9546f2410e4c56b88de85fb4f1f5d5&scope.system=all&role.id=ef0525432e044dd18b3ae4b32d29030e => generated 510 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:09.529160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48884151-7b37-4dba-b935-48bb387744cf None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:09.529678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48884151-7b37-4dba-b935-48bb387744cf None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:09.529678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48884151-7b37-4dba-b935-48bb387744cf None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:09.531319 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 166/335] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:09.537110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17ac2b-644c-461c-a7b2-391ff1f2d778 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:09.537631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17ac2b-644c-461c-a7b2-391ff1f2d778 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:09.537631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17ac2b-644c-461c-a7b2-391ff1f2d778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:09.559090 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-ab17ac2b-644c-461c-a7b2-391ff1f2d778 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:09.560281 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-ab17ac2b-644c-461c-a7b2-391ff1f2d778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:09.634430 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 170/336] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:18:09.755940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e6a31-d4d9-426c-ba79-cdf97248b295 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:09.756268 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e6a31-d4d9-426c-ba79-cdf97248b295 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:09.756488 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e6a31-d4d9-426c-ba79-cdf97248b295 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:09.758074 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 167/337] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:09.764096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad1836-5d59-4562-9788-80aa78adcacc None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:09.764378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad1836-5d59-4562-9788-80aa78adcacc None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:09.764647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad1836-5d59-4562-9788-80aa78adcacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:09.795931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-4bad1836-5d59-4562-9788-80aa78adcacc None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:09.797138 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4bad1836-5d59-4562-9788-80aa78adcacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:09.876450 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 171/338] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:10.140694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e6a31-d4d9-426c-ba79-cdf97248b295 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:10.284836 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e6a31-d4d9-426c-ba79-cdf97248b295 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:10.314876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:10.329287 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccec20-12be-4f21-bc3a-078c109b11ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:10.329941 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccec20-12be-4f21-bc3a-078c109b11ad None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:10.330278 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccec20-12be-4f21-bc3a-078c109b11ad None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:10.330488 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccec20-12be-4f21-bc3a-078c109b11ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:10.352075 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccec20-12be-4f21-bc3a-078c109b11ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:10.358001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-31ccec20-12be-4f21-bc3a-078c109b11ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:18:10.358001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:10.358001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:10.358001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:10.358001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:10.358001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:10.358001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:10.358001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:10.358001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:10.358001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:10.358001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:10.358001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:10.358001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:10.358001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:10.358001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:10.358001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:10.359071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:10.359071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:10.359071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:10.359071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:10.359071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:10.359071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:10.359071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:10.359071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:10.359071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:10.359071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:10.359071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:10.359071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:10.359071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:10.359071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:10.359071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:10.359071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:10.359891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:10.359891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:10.359891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:10.359891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:10.359891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:10.359891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:10.359891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:10.359891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:10.359891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:10.359891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:10.359891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:18:10.359891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:10.359891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 168/339] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:10.365379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad1836-5d59-4562-9788-80aa78adcacc None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:10.394180 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:10.418854 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c3b85-6022-42e2-b84b-d41d82aefbab None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:10.418854 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c3b85-6022-42e2-b84b-d41d82aefbab None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:10.418854 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c3b85-6022-42e2-b84b-d41d82aefbab None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:10.418854 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 169/340] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:18:10.422380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91f03a-5070-4291-9bbf-65caacfbd66b None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:10.422380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91f03a-5070-4291-9bbf-65caacfbd66b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:10.422380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91f03a-5070-4291-9bbf-65caacfbd66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:10.457989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-9a91f03a-5070-4291-9bbf-65caacfbd66b None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:10.459222 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-9a91f03a-5070-4291-9bbf-65caacfbd66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:10.530522 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad1836-5d59-4562-9788-80aa78adcacc None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:10.579380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c17885-d127-42f9-ad4c-afed651f52b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:10.580015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 170/341] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:18:10.580716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91f03a-5070-4291-9bbf-65caacfbd66b None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:10.581185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c17885-d127-42f9-ad4c-afed651f52b8 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:10.581596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c17885-d127-42f9-ad4c-afed651f52b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:10.581997 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c17885-d127-42f9-ad4c-afed651f52b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:10.582789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c17885-d127-42f9-ad4c-afed651f52b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:10.587347 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c17885-d127-42f9-ad4c-afed651f52b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:10.589025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c17885-d127-42f9-ad4c-afed651f52b8 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:10.603349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 172/342] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:18:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:10.605373 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04969f-400c-4283-ac57-536c506ab720 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:10.605831 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04969f-400c-4283-ac57-536c506ab720 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:10.606271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04969f-400c-4283-ac57-536c506ab720 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:10.612924 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 173/343] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:10.616211 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04969f-400c-4283-ac57-536c506ab720 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:10.716648 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:10.744804 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04969f-400c-4283-ac57-536c506ab720 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:10.763811 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91f03a-5070-4291-9bbf-65caacfbd66b None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:10.785527 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:10.786024 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbde08-596d-4f04-8130-8aef4935e1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:10.787086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbde08-596d-4f04-8130-8aef4935e1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:10.787505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbde08-596d-4f04-8130-8aef4935e1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:10.787917 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbde08-596d-4f04-8130-8aef4935e1c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:10.847591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756c66b-c4f4-4a57-bb6f-4882b3c6023b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:10.848529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756c66b-c4f4-4a57-bb6f-4882b3c6023b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:10.848960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756c66b-c4f4-4a57-bb6f-4882b3c6023b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:10.849395 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756c66b-c4f4-4a57-bb6f-4882b3c6023b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:10.866157 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbde08-596d-4f04-8130-8aef4935e1c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:10.867878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbde08-596d-4f04-8130-8aef4935e1c1 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:10.884193 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756c66b-c4f4-4a57-bb6f-4882b3c6023b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:10.894848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-7756c66b-c4f4-4a57-bb6f-4882b3c6023b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:18:10.894848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:10.894848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:10.894848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:10.894848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:10.894848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:10.894848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:10.894848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:10.894848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:10.894848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:10.894848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:10.894848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:10.894848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:10.894848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:10.894848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:10.894848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:10.895798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:10.895798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:10.895798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:10.895798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:10.895798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:10.895798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:10.895798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:10.895798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:10.895798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:10.895798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:10.895798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:10.895798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:10.895798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:10.895798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:10.895798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:10.895798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:10.896636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:10.896636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:10.896636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:10.896636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:10.896636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:10.896636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:10.896636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:10.896636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:10.896636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:10.896636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:10.896636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:18:10.896636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:10.899632 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 171/344] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:10.901078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c15f0-4e86-467d-8162-a7a07af1b8f1 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:10.901589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c15f0-4e86-467d-8162-a7a07af1b8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:10.902040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c15f0-4e86-467d-8162-a7a07af1b8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:10.939849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-0b6c15f0-4e86-467d-8162-a7a07af1b8f1 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:10.941303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-0b6c15f0-4e86-467d-8162-a7a07af1b8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:10.955743 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:10.997222 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 174/345] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:18:11.002677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbde08-596d-4f04-8130-8aef4935e1c1 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:11.029884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 172/346] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:11.031200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c15f0-4e86-467d-8162-a7a07af1b8f1 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:11.193036 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbde08-596d-4f04-8130-8aef4935e1c1 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:11.217549 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c15f0-4e86-467d-8162-a7a07af1b8f1 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:11.220778 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:11.266337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0364dea-9a0a-49c8-8d87-13ac216bad34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:11.267450 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0364dea-9a0a-49c8-8d87-13ac216bad34 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:11.268022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0364dea-9a0a-49c8-8d87-13ac216bad34 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:11.268491 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0364dea-9a0a-49c8-8d87-13ac216bad34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:11.276035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaca67-6c1d-44b8-b5c1-1c2fcd2e379b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:11.277391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaca67-6c1d-44b8-b5c1-1c2fcd2e379b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:11.277708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaca67-6c1d-44b8-b5c1-1c2fcd2e379b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:11.278045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaca67-6c1d-44b8-b5c1-1c2fcd2e379b None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:11.279025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeaca67-6c1d-44b8-b5c1-1c2fcd2e379b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:11.279330 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeaca67-6c1d-44b8-b5c1-1c2fcd2e379b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:11.280719 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeaca67-6c1d-44b8-b5c1-1c2fcd2e379b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:11.282273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0364dea-9a0a-49c8-8d87-13ac216bad34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:11.289973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-b0364dea-9a0a-49c8-8d87-13ac216bad34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:18:11.289973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:11.289973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:11.289973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:11.289973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:11.289973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:11.289973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:11.289973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:11.289973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:11.289973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:11.289973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:11.289973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:11.289973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:11.289973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:11.289973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:11.289973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:11.291028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:11.291028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:11.291028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:11.291028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:11.291028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:11.291028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:11.291028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:11.291028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:11.291028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:11.291028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:11.291028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:11.291028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:11.291028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:11.291028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:11.291028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:11.291028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:11.292015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:11.292015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:11.292015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:11.292015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:11.292015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:11.292015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:11.292015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:11.292015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:11.292015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:11.292015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:11.292015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:18:11.292015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:11.294477 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 173/347] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:11.295634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0364dea-9a0a-49c8-8d87-13ac216bad34 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:11.301346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 175/348] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:18:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:11.302468 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaca67-6c1d-44b8-b5c1-1c2fcd2e379b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:11.403813 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:11.449908 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0364dea-9a0a-49c8-8d87-13ac216bad34 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:11.471378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaca67-6c1d-44b8-b5c1-1c2fcd2e379b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:11.501098 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06bab6-f59d-4b1c-8ae5-0e8a2e846faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:11.502015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06bab6-f59d-4b1c-8ae5-0e8a2e846faf None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:11.502300 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06bab6-f59d-4b1c-8ae5-0e8a2e846faf None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:11.502573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06bab6-f59d-4b1c-8ae5-0e8a2e846faf None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:11.503973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06bab6-f59d-4b1c-8ae5-0e8a2e846faf None admin] RBAC: Authorizing `identity:get_project(project_id=9bbb5023e47c45f49813194c41890827)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:11.506035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06bab6-f59d-4b1c-8ae5-0e8a2e846faf None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:11.508998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 174/349] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:18:11 2022] GET /identity/v3/projects/9bbb5023e47c45f49813194c41890827 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:11.510028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06bab6-f59d-4b1c-8ae5-0e8a2e846faf None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:11.518574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047d0da-bf0f-456d-ada6-44f20b9dacb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:11.519424 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047d0da-bf0f-456d-ada6-44f20b9dacb9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:11.519860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047d0da-bf0f-456d-ada6-44f20b9dacb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:11.520266 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047d0da-bf0f-456d-ada6-44f20b9dacb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:11.522449 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047d0da-bf0f-456d-ada6-44f20b9dacb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:11.522929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047d0da-bf0f-456d-ada6-44f20b9dacb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:11.525209 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047d0da-bf0f-456d-ada6-44f20b9dacb9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:11.536401 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 176/350] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:18:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:11.537498 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047d0da-bf0f-456d-ada6-44f20b9dacb9 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:11.552068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:11.645162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06bab6-f59d-4b1c-8ae5-0e8a2e846faf None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:11.664037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047d0da-bf0f-456d-ada6-44f20b9dacb9 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:11.675752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:11.706370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b437c5-4e58-4983-b859-c64b8471ef28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:11.707168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b437c5-4e58-4983-b859-c64b8471ef28 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:11.707644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b437c5-4e58-4983-b859-c64b8471ef28 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:11.708100 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b437c5-4e58-4983-b859-c64b8471ef28 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:11.719665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a961953-9040-4b2a-9971-6b8b08fc8c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:11.720610 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a961953-9040-4b2a-9971-6b8b08fc8c67 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:11.721033 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a961953-9040-4b2a-9971-6b8b08fc8c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:11.721446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a961953-9040-4b2a-9971-6b8b08fc8c67 None admin] PATH_INFO: `/v3/users/b475625a149c41449e3c35c4f0db0536` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:11.722614 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b437c5-4e58-4983-b859-c64b8471ef28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:11.723444 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a961953-9040-4b2a-9971-6b8b08fc8c67 None admin] RBAC: Authorizing `identity:get_user(user_id=b475625a149c41449e3c35c4f0db0536)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:11.725074 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a961953-9040-4b2a-9971-6b8b08fc8c67 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:11.727282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 175/351] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:18:11 2022] GET /identity/v3/users/b475625a149c41449e3c35c4f0db0536 => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:11.728194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a961953-9040-4b2a-9971-6b8b08fc8c67 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:11.728337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-62b437c5-4e58-4983-b859-c64b8471ef28 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:18:11.728337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:11.728337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:11.728337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:11.728337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:11.728337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:11.728337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:11.728337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:11.728337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:11.728337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:11.728337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:11.728337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:11.728337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:11.728337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:11.728337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:11.728337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:11.730550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:11.730550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:11.730550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:11.730550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:11.730550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:11.730550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:11.730550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:11.730550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:11.730550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:11.730550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:11.730550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:11.730550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:11.730550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:11.730550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:11.730550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:11.730550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:11.731852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:11.731852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:11.731852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:11.731852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:11.731852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:11.731852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:11.731852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:11.731852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:11.731852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:11.731852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:11.731852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:18:11.731852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:11.731852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 177/352] 10.222.0.25 () {56 vars in 1114 bytes} [Sat Sep 24 19:18:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:11.732834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b437c5-4e58-4983-b859-c64b8471ef28 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:11.865197 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a961953-9040-4b2a-9971-6b8b08fc8c67 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:11.868029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b437c5-4e58-4983-b859-c64b8471ef28 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:11.883398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:11.909185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05578e5e-bd69-44b1-91a6-f0005d4a42e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:11.910242 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05578e5e-bd69-44b1-91a6-f0005d4a42e1 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:11.910967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05578e5e-bd69-44b1-91a6-f0005d4a42e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:11.911442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05578e5e-bd69-44b1-91a6-f0005d4a42e1 None admin] PATH_INFO: `/v3/groups/0ea3d11086ca49b984fe1ddefda79675` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:11.911962 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837e8c9-e33f-4073-9344-e241302802bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:11.912579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837e8c9-e33f-4073-9344-e241302802bd None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:11.912843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837e8c9-e33f-4073-9344-e241302802bd None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:11.913110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837e8c9-e33f-4073-9344-e241302802bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:11.919877 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05578e5e-bd69-44b1-91a6-f0005d4a42e1 None admin] RBAC: Authorizing `identity:get_group(group_id=0ea3d11086ca49b984fe1ddefda79675)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:11.921330 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05578e5e-bd69-44b1-91a6-f0005d4a42e1 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:11.923175 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 176/353] 10.222.0.25 () {56 vars in 1180 bytes} [Sat Sep 24 19:18:11 2022] GET /identity/v3/groups/0ea3d11086ca49b984fe1ddefda79675 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:11.923854 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05578e5e-bd69-44b1-91a6-f0005d4a42e1 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:11.947242 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:11.997865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837e8c9-e33f-4073-9344-e241302802bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:11.999485 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837e8c9-e33f-4073-9344-e241302802bd None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:12.041434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05578e5e-bd69-44b1-91a6-f0005d4a42e1 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:12.088796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d978d5-1d32-411b-810e-c288486a97fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:12.089423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d978d5-1d32-411b-810e-c288486a97fb None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:12.089695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d978d5-1d32-411b-810e-c288486a97fb None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:12.089968 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d978d5-1d32-411b-810e-c288486a97fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:12.090696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d978d5-1d32-411b-810e-c288486a97fb None admin] RBAC: Adding query filter params (role.id=4b618f407f654e32a6a29da3aa4f83e2, user.id=b475625a149c41449e3c35c4f0db0536, scope.system=all) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:12.091083 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d978d5-1d32-411b-810e-c288486a97fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:12.092606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d978d5-1d32-411b-810e-c288486a97fb None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:12.111102 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 177/354] 10.222.0.25 () {56 vars in 1308 bytes} [Sat Sep 24 19:18:11 2022] GET /identity/v3/role_assignments?user.id=b475625a149c41449e3c35c4f0db0536&scope.system=all&role.id=4b618f407f654e32a6a29da3aa4f83e2 => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:12.111102 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d978d5-1d32-411b-810e-c288486a97fb None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:12.121853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 178/355] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:18:12.122902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcddfa-eef9-4d60-aa82-69009240ed62 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:12.123189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcddfa-eef9-4d60-aa82-69009240ed62 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:12.123457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbcddfa-eef9-4d60-aa82-69009240ed62 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:12.125077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 179/356] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:12.125882 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcddfa-eef9-4d60-aa82-69009240ed62 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:12.144830 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:12.224713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:12.262526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d978d5-1d32-411b-810e-c288486a97fb None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:12.278455 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbcddfa-eef9-4d60-aa82-69009240ed62 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:12.307065 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e12a2-d7a6-40e4-9cd4-c6b58ab70ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:12.307852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e12a2-d7a6-40e4-9cd4-c6b58ab70ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:12.308458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e12a2-d7a6-40e4-9cd4-c6b58ab70ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:12.308685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e12a2-d7a6-40e4-9cd4-c6b58ab70ee3 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:12.309442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e12a2-d7a6-40e4-9cd4-c6b58ab70ee3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:12.309662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e12a2-d7a6-40e4-9cd4-c6b58ab70ee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:12.311256 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e12a2-d7a6-40e4-9cd4-c6b58ab70ee3 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:12.323399 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 178/357] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:12.324780 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8276594-00b6-4695-ab93-76855d1e42a1 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:12.325066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8276594-00b6-4695-ab93-76855d1e42a1 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:12.325338 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8276594-00b6-4695-ab93-76855d1e42a1 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:12.326675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 179/358] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:12.327238 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8276594-00b6-4695-ab93-76855d1e42a1 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:12.335586 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578364a-99f0-4698-abbd-23b8e2cbc557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:12.336210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578364a-99f0-4698-abbd-23b8e2cbc557 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:12.336492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578364a-99f0-4698-abbd-23b8e2cbc557 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:12.336765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578364a-99f0-4698-abbd-23b8e2cbc557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:12.337498 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578364a-99f0-4698-abbd-23b8e2cbc557 None admin] RBAC: Adding query filter params (group.id=0ea3d11086ca49b984fe1ddefda79675, role.id=ef0525432e044dd18b3ae4b32d29030e, scope.project.id=9bbb5023e47c45f49813194c41890827) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:12.337858 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578364a-99f0-4698-abbd-23b8e2cbc557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:12.340605 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578364a-99f0-4698-abbd-23b8e2cbc557 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:12.346300 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 180/359] 10.222.0.25 () {56 vars in 1376 bytes} [Sat Sep 24 19:18:12 2022] GET /identity/v3/role_assignments?group.id=0ea3d11086ca49b984fe1ddefda79675&scope.project.id=9bbb5023e47c45f49813194c41890827&role.id=ef0525432e044dd18b3ae4b32d29030e => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:12.347687 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a51a63-0f34-4842-a094-883142f436a2 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:12.347976 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a51a63-0f34-4842-a094-883142f436a2 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:12.348424 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a51a63-0f34-4842-a094-883142f436a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:12.372708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-34a51a63-0f34-4842-a094-883142f436a2 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:12.374476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-34a51a63-0f34-4842-a094-883142f436a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:12.451655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:12.470611 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 181/360] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:12.471529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a51a63-0f34-4842-a094-883142f436a2 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:12.472885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8276594-00b6-4695-ab93-76855d1e42a1 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:12.519452 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6837f63-ffe2-440a-8cc4-aef6e9d963e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:12.520501 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6837f63-ffe2-440a-8cc4-aef6e9d963e7 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:12.520987 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6837f63-ffe2-440a-8cc4-aef6e9d963e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:12.521479 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6837f63-ffe2-440a-8cc4-aef6e9d963e7 None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:12.523094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6837f63-ffe2-440a-8cc4-aef6e9d963e7 None admin] RBAC: Authorizing `identity:get_project(project_id=54174d12726547b4bb37d9dd5c21798a)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:12.525582 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6837f63-ffe2-440a-8cc4-aef6e9d963e7 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:12.528527 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 180/361] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:18:12 2022] GET /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:12.529754 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0091e-f3d4-4261-905f-981ff9ea4547 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:12.530141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0091e-f3d4-4261-905f-981ff9ea4547 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:12.530567 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0091e-f3d4-4261-905f-981ff9ea4547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:12.547598 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:12.557123 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-4da0091e-f3d4-4261-905f-981ff9ea4547 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:12.558543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4da0091e-f3d4-4261-905f-981ff9ea4547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:12.622912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a51a63-0f34-4842-a094-883142f436a2 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:12.640939 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 181/362] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:12.641999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0091e-f3d4-4261-905f-981ff9ea4547 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:12.663514 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf532a8-4f9c-4288-ba80-364ee82e0ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:12.664262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf532a8-4f9c-4288-ba80-364ee82e0ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:12.664790 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf532a8-4f9c-4288-ba80-364ee82e0ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:12.664790 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf532a8-4f9c-4288-ba80-364ee82e0ff2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:12.743361 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf532a8-4f9c-4288-ba80-364ee82e0ff2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:12.744949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf532a8-4f9c-4288-ba80-364ee82e0ff2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:12.793976 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:12.805202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:12.824484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0091e-f3d4-4261-905f-981ff9ea4547 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:12.861197 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 182/363] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:18:12.862350 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf532a8-4f9c-4288-ba80-364ee82e0ff2 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:12.865701 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb8b25-c19f-4b83-a7d0-40247143cf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:12.866344 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb8b25-c19f-4b83-a7d0-40247143cf88 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:12.866625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb8b25-c19f-4b83-a7d0-40247143cf88 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:12.867019 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb8b25-c19f-4b83-a7d0-40247143cf88 None admin] PATH_INFO: `/v3/groups/0ea3d11086ca49b984fe1ddefda79675` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:12.868145 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb8b25-c19f-4b83-a7d0-40247143cf88 None admin] RBAC: Authorizing `identity:get_group(group_id=0ea3d11086ca49b984fe1ddefda79675)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:12.869794 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb8b25-c19f-4b83-a7d0-40247143cf88 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:12.871481 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 182/364] 10.222.0.25 () {56 vars in 1180 bytes} [Sat Sep 24 19:18:12 2022] GET /identity/v3/groups/0ea3d11086ca49b984fe1ddefda79675 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:12.877475 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb8b25-c19f-4b83-a7d0-40247143cf88 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:12.989324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf532a8-4f9c-4288-ba80-364ee82e0ff2 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:12.999887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb8b25-c19f-4b83-a7d0-40247143cf88 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:13.035601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350c356-54fc-4aa6-b438-2c2d501de0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:13.036242 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350c356-54fc-4aa6-b438-2c2d501de0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:13.036518 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350c356-54fc-4aa6-b438-2c2d501de0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:13.036786 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350c356-54fc-4aa6-b438-2c2d501de0f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:13.048548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350c356-54fc-4aa6-b438-2c2d501de0f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:13.049290 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa92e48-3bea-4ceb-9829-1446a36558dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:13.050145 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa92e48-3bea-4ceb-9829-1446a36558dc None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:13.050431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa92e48-3bea-4ceb-9829-1446a36558dc None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:13.050710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa92e48-3bea-4ceb-9829-1446a36558dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:13.051519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa92e48-3bea-4ceb-9829-1446a36558dc None admin] RBAC: Adding query filter params (group.id=0ea3d11086ca49b984fe1ddefda79675, role.id=ef0525432e044dd18b3ae4b32d29030e, scope.project.id=54174d12726547b4bb37d9dd5c21798a) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:13.051829 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa92e48-3bea-4ceb-9829-1446a36558dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:13.053253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa92e48-3bea-4ceb-9829-1446a36558dc None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:13.054406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-7350c356-54fc-4aa6-b438-2c2d501de0f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:18:13.054406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:13.054406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:13.054406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:13.054406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:13.054406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:13.054406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:13.054406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:13.054406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:13.054406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:13.054406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:13.054406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:13.054406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:13.054406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:13.054406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:13.054406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:13.055484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:13.055484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:13.055484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:13.055484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:13.055484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:13.055484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:13.055484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:13.055484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:13.055484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:13.055484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:13.055484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:13.055484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:13.055484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:13.055484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:13.055484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:13.055484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:13.056377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:13.056377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:13.056377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:13.056377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:13.056377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:13.056377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:13.056377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:13.056377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:13.056377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:13.056377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:13.056377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:18:13.056377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:13.059816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 183/365] 10.222.0.25 () {56 vars in 1114 bytes} [Sat Sep 24 19:18:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:13.059816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350c356-54fc-4aa6-b438-2c2d501de0f9 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:13.063437 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 183/366] 10.222.0.25 () {56 vars in 1376 bytes} [Sat Sep 24 19:18:12 2022] GET /identity/v3/role_assignments?group.id=0ea3d11086ca49b984fe1ddefda79675&scope.project.id=54174d12726547b4bb37d9dd5c21798a&role.id=ef0525432e044dd18b3ae4b32d29030e => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:13.064272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa92e48-3bea-4ceb-9829-1446a36558dc None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:13.083060 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:13.088204 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:13.194484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa92e48-3bea-4ceb-9829-1446a36558dc None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:13.205823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350c356-54fc-4aa6-b438-2c2d501de0f9 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:13.240229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e629d-30a2-4bb1-b79b-21588e9caecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:13.241232 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e629d-30a2-4bb1-b79b-21588e9caecd None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:13.241715 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e629d-30a2-4bb1-b79b-21588e9caecd None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:13.242194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e629d-30a2-4bb1-b79b-21588e9caecd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:13.255022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd2462-93e8-4cdd-8903-da1483df8fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:13.255690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd2462-93e8-4cdd-8903-da1483df8fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:13.255968 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd2462-93e8-4cdd-8903-da1483df8fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:13.256237 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd2462-93e8-4cdd-8903-da1483df8fe5 None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:13.256536 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e629d-30a2-4bb1-b79b-21588e9caecd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:13.257594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd2462-93e8-4cdd-8903-da1483df8fe5 None admin] RBAC: Authorizing `identity:get_project(project_id=9bbb5023e47c45f49813194c41890827)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:13.259096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd2462-93e8-4cdd-8903-da1483df8fe5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:13.264122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 184/367] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:18:13 2022] GET /identity/v3/projects/9bbb5023e47c45f49813194c41890827 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:13.264122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd2462-93e8-4cdd-8903-da1483df8fe5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:13.266317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-158e629d-30a2-4bb1-b79b-21588e9caecd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:18:13.266317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:13.266317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:13.266317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:13.266317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:13.266317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:13.266317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:13.266317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:13.266317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:13.266317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:13.266317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:13.266317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:13.266317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:13.266317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:13.266317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:13.266317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:13.267456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:13.267456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:13.267456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:13.267456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:13.267456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:13.267456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:13.267456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:13.267456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:13.267456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:13.267456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:13.267456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:13.267456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:13.267456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:13.267456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:13.267456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:13.267456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:13.268289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:13.268289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:13.268289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:13.268289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:13.268289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:13.268289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:13.268289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:13.268289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:13.268289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:13.268289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:13.268289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:18:13.268289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:13.271491 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 184/368] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:18:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:13.277798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e629d-30a2-4bb1-b79b-21588e9caecd None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:13.381456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:13.386974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:13.400875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd2462-93e8-4cdd-8903-da1483df8fe5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:13.407070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e629d-30a2-4bb1-b79b-21588e9caecd None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:13.440846 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e9130-cf2e-4ef0-9e1a-ef9d61c74a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:13.441713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e9130-cf2e-4ef0-9e1a-ef9d61c74a4a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:13.441991 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e9130-cf2e-4ef0-9e1a-ef9d61c74a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:13.442264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e9130-cf2e-4ef0-9e1a-ef9d61c74a4a None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:13.442957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e9130-cf2e-4ef0-9e1a-ef9d61c74a4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:13.443259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e9130-cf2e-4ef0-9e1a-ef9d61c74a4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:13.444672 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e9130-cf2e-4ef0-9e1a-ef9d61c74a4a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:13.446649 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14e7f3-3eed-4f80-bb32-c623db532d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:13.447589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14e7f3-3eed-4f80-bb32-c623db532d95 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:13.448627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14e7f3-3eed-4f80-bb32-c623db532d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:13.449378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14e7f3-3eed-4f80-bb32-c623db532d95 None admin] PATH_INFO: `/v3/groups/0ea3d11086ca49b984fe1ddefda79675` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:13.450918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14e7f3-3eed-4f80-bb32-c623db532d95 None admin] RBAC: Authorizing `identity:get_group(group_id=0ea3d11086ca49b984fe1ddefda79675)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:13.452727 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a14e7f3-3eed-4f80-bb32-c623db532d95 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:13.454590 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 185/370] 10.222.0.25 () {56 vars in 1180 bytes} [Sat Sep 24 19:18:13 2022] GET /identity/v3/groups/0ea3d11086ca49b984fe1ddefda79675 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:13.455638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14e7f3-3eed-4f80-bb32-c623db532d95 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:13.461806 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 185/370] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:13.461806 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e9130-cf2e-4ef0-9e1a-ef9d61c74a4a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:13.578973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e9130-cf2e-4ef0-9e1a-ef9d61c74a4a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:13.582002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14e7f3-3eed-4f80-bb32-c623db532d95 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:13.622474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141f893-66be-4867-8f28-d6c465b6b3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:13.623112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141f893-66be-4867-8f28-d6c465b6b3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:13.623379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141f893-66be-4867-8f28-d6c465b6b3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:13.623652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141f893-66be-4867-8f28-d6c465b6b3d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:13.636795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e18cd-e119-4031-81f0-72d5b3385c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:13.637416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e18cd-e119-4031-81f0-72d5b3385c41 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:13.637698 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e18cd-e119-4031-81f0-72d5b3385c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:13.637968 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e18cd-e119-4031-81f0-72d5b3385c41 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:13.639164 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e18cd-e119-4031-81f0-72d5b3385c41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:13.639475 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e18cd-e119-4031-81f0-72d5b3385c41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:13.641553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e18cd-e119-4031-81f0-72d5b3385c41 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:13.644025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:13.658664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 186/371] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:13.659964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e18cd-e119-4031-81f0-72d5b3385c41 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:13.665389 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:13.724668 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141f893-66be-4867-8f28-d6c465b6b3d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:13.726037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141f893-66be-4867-8f28-d6c465b6b3d9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:13.796332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e18cd-e119-4031-81f0-72d5b3385c41 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:13.834141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac7f34-eaba-47c6-ab7b-e6cd6dd23d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:13.834781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac7f34-eaba-47c6-ab7b-e6cd6dd23d44 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:13.835089 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac7f34-eaba-47c6-ab7b-e6cd6dd23d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:13.835920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac7f34-eaba-47c6-ab7b-e6cd6dd23d44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:13.836871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac7f34-eaba-47c6-ab7b-e6cd6dd23d44 None admin] RBAC: Adding query filter params (group.id=0ea3d11086ca49b984fe1ddefda79675, role.id=655c93c88bc34badbfd2aad45491a96b, scope.project.id=9bbb5023e47c45f49813194c41890827) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:13.837316 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac7f34-eaba-47c6-ab7b-e6cd6dd23d44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:13.839928 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac7f34-eaba-47c6-ab7b-e6cd6dd23d44 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:13.848822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 187/372] 10.222.0.25 () {56 vars in 1376 bytes} [Sat Sep 24 19:18:13 2022] GET /identity/v3/role_assignments?group.id=0ea3d11086ca49b984fe1ddefda79675&scope.project.id=9bbb5023e47c45f49813194c41890827&role.id=655c93c88bc34badbfd2aad45491a96b => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:13.849736 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac7f34-eaba-47c6-ab7b-e6cd6dd23d44 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:13.851593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 186/373] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 19:18:13.860307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141f893-66be-4867-8f28-d6c465b6b3d9 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:13.979818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:13.981123 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:14.028997 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac7f34-eaba-47c6-ab7b-e6cd6dd23d44 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:14.071697 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd26ec-2eaf-42a3-9a1e-f5e91c11dc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:14.072313 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd26ec-2eaf-42a3-9a1e-f5e91c11dc0a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:14.072744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd26ec-2eaf-42a3-9a1e-f5e91c11dc0a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:14.073547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd26ec-2eaf-42a3-9a1e-f5e91c11dc0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:14.107909 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141f893-66be-4867-8f28-d6c465b6b3d9 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:14.145580 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a959ec8-7745-47e1-9562-a4a09e3663d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:14.146535 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a959ec8-7745-47e1-9562-a4a09e3663d3 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:14.147050 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a959ec8-7745-47e1-9562-a4a09e3663d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:14.147608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a959ec8-7745-47e1-9562-a4a09e3663d3 None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:14.149184 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a959ec8-7745-47e1-9562-a4a09e3663d3 None admin] RBAC: Authorizing `identity:get_project(project_id=54174d12726547b4bb37d9dd5c21798a)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:14.150852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a959ec8-7745-47e1-9562-a4a09e3663d3 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:14.152816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd26ec-2eaf-42a3-9a1e-f5e91c11dc0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:14.153445 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 187/374] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:18:13 2022] GET /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a => generated 302 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:14.155819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd26ec-2eaf-42a3-9a1e-f5e91c11dc0a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:14.159472 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a959ec8-7745-47e1-9562-a4a09e3663d3 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:14.236553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:14.271372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a959ec8-7745-47e1-9562-a4a09e3663d3 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:14.280972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 188/375] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:18:14.282997 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd26ec-2eaf-42a3-9a1e-f5e91c11dc0a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:14.290567 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:14.315057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73db79b-f814-4374-a52d-dc62df896817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:14.316116 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73db79b-f814-4374-a52d-dc62df896817 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:14.316594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73db79b-f814-4374-a52d-dc62df896817 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:14.317057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73db79b-f814-4374-a52d-dc62df896817 None admin] PATH_INFO: `/v3/groups/0ea3d11086ca49b984fe1ddefda79675` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:14.318522 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73db79b-f814-4374-a52d-dc62df896817 None admin] RBAC: Authorizing `identity:get_group(group_id=0ea3d11086ca49b984fe1ddefda79675)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:14.320792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73db79b-f814-4374-a52d-dc62df896817 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:14.322582 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 188/376] 10.222.0.25 () {56 vars in 1180 bytes} [Sat Sep 24 19:18:14 2022] GET /identity/v3/groups/0ea3d11086ca49b984fe1ddefda79675 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:14.344276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73db79b-f814-4374-a52d-dc62df896817 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:14.428494 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd26ec-2eaf-42a3-9a1e-f5e91c11dc0a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:14.489459 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b99ad-7fd4-4ced-9a83-b8535b0d2d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:14.490269 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b99ad-7fd4-4ced-9a83-b8535b0d2d7a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:14.490553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b99ad-7fd4-4ced-9a83-b8535b0d2d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:14.490849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b99ad-7fd4-4ced-9a83-b8535b0d2d7a None admin] PATH_INFO: `/v3/projects/80330a20cbd94abd8d12b2c485818669` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:14.492666 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b99ad-7fd4-4ced-9a83-b8535b0d2d7a None admin] RBAC: Authorizing `identity:get_project(project_id=80330a20cbd94abd8d12b2c485818669)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:14.494122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b99ad-7fd4-4ced-9a83-b8535b0d2d7a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:14.497519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 189/377] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:18:14 2022] GET /identity/v3/projects/80330a20cbd94abd8d12b2c485818669 => generated 344 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:14.504165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b99ad-7fd4-4ced-9a83-b8535b0d2d7a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:14.514756 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73db79b-f814-4374-a52d-dc62df896817 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:14.545913 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:14.556516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd2e15-d9bc-437b-8316-0b056ee56c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:14.557102 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd2e15-d9bc-437b-8316-0b056ee56c99 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:14.558062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd2e15-d9bc-437b-8316-0b056ee56c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:14.558168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd2e15-d9bc-437b-8316-0b056ee56c99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:14.558902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd2e15-d9bc-437b-8316-0b056ee56c99 None admin] RBAC: Adding query filter params (group.id=0ea3d11086ca49b984fe1ddefda79675, role.id=655c93c88bc34badbfd2aad45491a96b, scope.project.id=54174d12726547b4bb37d9dd5c21798a) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:14.559261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd2e15-d9bc-437b-8316-0b056ee56c99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:14.564559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd2e15-d9bc-437b-8316-0b056ee56c99 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:14.571493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 189/378] 10.222.0.25 () {56 vars in 1376 bytes} [Sat Sep 24 19:18:14 2022] GET /identity/v3/role_assignments?group.id=0ea3d11086ca49b984fe1ddefda79675&scope.project.id=54174d12726547b4bb37d9dd5c21798a&role.id=655c93c88bc34badbfd2aad45491a96b => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:14.643568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b99ad-7fd4-4ced-9a83-b8535b0d2d7a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:14.687908 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119858e-3279-480f-ae17-bc0a2380100b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:14.688556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119858e-3279-480f-ae17-bc0a2380100b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:14.688837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119858e-3279-480f-ae17-bc0a2380100b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:14.689111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119858e-3279-480f-ae17-bc0a2380100b None admin] PATH_INFO: `/v3/groups/709615f3b52442ee95936e1597777228` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:14.694313 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119858e-3279-480f-ae17-bc0a2380100b None admin] RBAC: Authorizing `identity:get_group(group_id=709615f3b52442ee95936e1597777228)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:14.695858 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119858e-3279-480f-ae17-bc0a2380100b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:14.697800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 190/379] 10.222.0.25 () {56 vars in 1180 bytes} [Sat Sep 24 19:18:14 2022] GET /identity/v3/groups/709615f3b52442ee95936e1597777228 => generated 229 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:14.703840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd2e15-d9bc-437b-8316-0b056ee56c99 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:14.771286 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:14.825638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd2e15-d9bc-437b-8316-0b056ee56c99 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:14.863319 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127c064-2cb8-4065-b935-b3e8253182bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:14.863934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127c064-2cb8-4065-b935-b3e8253182bb None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:14.864280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127c064-2cb8-4065-b935-b3e8253182bb None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:14.864559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127c064-2cb8-4065-b935-b3e8253182bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:14.865343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127c064-2cb8-4065-b935-b3e8253182bb None admin] RBAC: Adding query filter params (group.id=709615f3b52442ee95936e1597777228, role.id=dd27845a836a4f6ebece149dbebc59c0, scope.project.id=80330a20cbd94abd8d12b2c485818669) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:14.865656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127c064-2cb8-4065-b935-b3e8253182bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:14.867115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127c064-2cb8-4065-b935-b3e8253182bb None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:14.873792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 190/380] 10.222.0.25 () {56 vars in 1376 bytes} [Sat Sep 24 19:18:14 2022] GET /identity/v3/role_assignments?group.id=709615f3b52442ee95936e1597777228&scope.project.id=80330a20cbd94abd8d12b2c485818669&role.id=dd27845a836a4f6ebece149dbebc59c0 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:15.135431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ea10b-0ea2-41bb-8da8-c0f8b6c3fdaa None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:15.135933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ea10b-0ea2-41bb-8da8-c0f8b6c3fdaa None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:15.136167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ea10b-0ea2-41bb-8da8-c0f8b6c3fdaa None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:15.137961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 191/381] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:15.144117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fa108-7e93-4c11-85d6-0c78df387943 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:15.144408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fa108-7e93-4c11-85d6-0c78df387943 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:15.144684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fa108-7e93-4c11-85d6-0c78df387943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:15.164396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-f91fa108-7e93-4c11-85d6-0c78df387943 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:15.165597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f91fa108-7e93-4c11-85d6-0c78df387943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:15.238306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 191/382] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:18:15.656170 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ea10b-0ea2-41bb-8da8-c0f8b6c3fdaa None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:15.790531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:15.794932 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c27090-b573-46c9-8ef2-c8141efc5cc4 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:15.795382 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c27090-b573-46c9-8ef2-c8141efc5cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:15.795606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c27090-b573-46c9-8ef2-c8141efc5cc4 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:15.796852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ea10b-0ea2-41bb-8da8-c0f8b6c3fdaa None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:15.801088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 192/383] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:15.802278 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e39d42-1e05-49a5-ace2-1f60e01e5b19 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:15.802558 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e39d42-1e05-49a5-ace2-1f60e01e5b19 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:15.802852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e39d42-1e05-49a5-ace2-1f60e01e5b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:15.833881 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-26e39d42-1e05-49a5-ace2-1f60e01e5b19 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:15.835093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-26e39d42-1e05-49a5-ace2-1f60e01e5b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:15.872808 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1bda3-19e2-43aa-abda-74ce5f81304f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:15.873516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1bda3-19e2-43aa-abda-74ce5f81304f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:15.873802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1bda3-19e2-43aa-abda-74ce5f81304f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:15.874075 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1bda3-19e2-43aa-abda-74ce5f81304f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:15.900433 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1bda3-19e2-43aa-abda-74ce5f81304f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:15.906068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-53d1bda3-19e2-43aa-abda-74ce5f81304f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:18:15.906068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:15.906068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:15.906068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:15.906068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:15.906068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:15.906068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:15.906068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:15.906068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:15.906068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:15.906068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:15.906068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:15.906068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:15.906068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:15.906068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:15.906068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:15.906989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:15.906989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:15.906989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:15.906989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:15.906989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:15.906989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:15.906989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:15.906989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:15.906989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:15.906989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:15.906989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:15.906989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:15.906989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:15.906989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:15.906989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:15.906989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:15.908053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:15.908053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:15.908053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:15.908053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:15.908053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:15.908053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:15.908053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:15.908053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:15.908053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:15.908053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:15.908053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:18:15.908053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:15.908053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 192/384] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:15.915149 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1bda3-19e2-43aa-abda-74ce5f81304f None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:15.929002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:15.997104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 193/385] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:16.060596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1bda3-19e2-43aa-abda-74ce5f81304f None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:16.106160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752252f-0b61-4ed6-8be9-3aef38d3c21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:16.107149 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752252f-0b61-4ed6-8be9-3aef38d3c21f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:16.107650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752252f-0b61-4ed6-8be9-3aef38d3c21f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:16.108119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752252f-0b61-4ed6-8be9-3aef38d3c21f None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:16.108999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752252f-0b61-4ed6-8be9-3aef38d3c21f None admin] RBAC: Adding query filter params (name=member) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:16.109496 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752252f-0b61-4ed6-8be9-3aef38d3c21f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:16.111187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752252f-0b61-4ed6-8be9-3aef38d3c21f None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:16.123854 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 193/386] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:18:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:16.129821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e39d42-1e05-49a5-ace2-1f60e01e5b19 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:16.247931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e39d42-1e05-49a5-ace2-1f60e01e5b19 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:16.289392 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91811f47-6de2-4941-883b-78b9e65a74ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:16.290386 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91811f47-6de2-4941-883b-78b9e65a74ec None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:16.290883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91811f47-6de2-4941-883b-78b9e65a74ec None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:16.291367 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91811f47-6de2-4941-883b-78b9e65a74ec None admin] PATH_INFO: `/v3/groups/0ea3d11086ca49b984fe1ddefda79675` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:16.293301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91811f47-6de2-4941-883b-78b9e65a74ec None admin] RBAC: Authorizing `identity:get_group(group_id=0ea3d11086ca49b984fe1ddefda79675)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:16.294975 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91811f47-6de2-4941-883b-78b9e65a74ec None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:16.300774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 194/387] 10.222.0.25 () {56 vars in 1180 bytes} [Sat Sep 24 19:18:16 2022] GET /identity/v3/groups/0ea3d11086ca49b984fe1ddefda79675 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:16.303021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752252f-0b61-4ed6-8be9-3aef38d3c21f None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:16.331415 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:16.343362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91811f47-6de2-4941-883b-78b9e65a74ec None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:16.409558 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:16.480983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752252f-0b61-4ed6-8be9-3aef38d3c21f None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:16.522824 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91811f47-6de2-4941-883b-78b9e65a74ec None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:16.528593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67022424-6c9c-410e-86c1-cb0626e9e7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:16.529230 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67022424-6c9c-410e-86c1-cb0626e9e7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:16.529509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67022424-6c9c-410e-86c1-cb0626e9e7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:16.529783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67022424-6c9c-410e-86c1-cb0626e9e7a5 None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:16.531001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67022424-6c9c-410e-86c1-cb0626e9e7a5 None admin] RBAC: Authorizing `identity:get_project(project_id=9bbb5023e47c45f49813194c41890827)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:16.532439 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67022424-6c9c-410e-86c1-cb0626e9e7a5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:16.538177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 194/388] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:18:16 2022] GET /identity/v3/projects/9bbb5023e47c45f49813194c41890827 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:16.540220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67022424-6c9c-410e-86c1-cb0626e9e7a5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:16.574817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effd5f9-b172-4209-8e8d-ada1ffd58779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:16.575473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effd5f9-b172-4209-8e8d-ada1ffd58779 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:16.575751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effd5f9-b172-4209-8e8d-ada1ffd58779 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:16.576022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effd5f9-b172-4209-8e8d-ada1ffd58779 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:16.592521 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effd5f9-b172-4209-8e8d-ada1ffd58779 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:16.597807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-6effd5f9-b172-4209-8e8d-ada1ffd58779 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:18:16.597807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:16.597807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:16.597807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:16.597807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:16.597807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:16.597807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:16.597807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:16.597807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:16.597807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:16.597807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:16.597807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:16.597807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:16.597807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:16.597807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:16.597807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:16.598675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:16.598675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:16.598675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:16.598675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:16.598675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:16.598675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:16.598675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:16.598675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:16.598675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:16.598675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:16.598675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:16.598675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:16.598675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:16.598675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:16.598675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:16.598675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:16.599585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:16.599585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:16.599585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:16.599585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:16.599585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:16.599585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:16.599585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:16.599585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:16.599585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:16.599585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:16.599585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:18:16.599585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:16.601642 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 195/389] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:18:16.611464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effd5f9-b172-4209-8e8d-ada1ffd58779 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:16.721235 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:16.736754 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67022424-6c9c-410e-86c1-cb0626e9e7a5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:16.753412 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effd5f9-b172-4209-8e8d-ada1ffd58779 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:16.755181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:16.772988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e2838-c06e-48b4-a3a1-f737be1593c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:16.773924 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e2838-c06e-48b4-a3a1-f737be1593c0 None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:16.774193 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e2838-c06e-48b4-a3a1-f737be1593c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:16.774622 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e2838-c06e-48b4-a3a1-f737be1593c0 None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827/groups/0ea3d11086ca49b984fe1ddefda79675/roles/ef0525432e044dd18b3ae4b32d29030e` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:16.777111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e2838-c06e-48b4-a3a1-f737be1593c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=9bbb5023e47c45f49813194c41890827, group_id=0ea3d11086ca49b984fe1ddefda79675, role_id=ef0525432e044dd18b3ae4b32d29030e)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:16.778546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e2838-c06e-48b4-a3a1-f737be1593c0 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:16.794445 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64112d26-caa8-4d7b-be4f-4478cc89d875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:16.794725 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 195/390] 10.222.0.25 () {58 vars in 1442 bytes} [Sat Sep 24 19:18:16 2022] PUT /identity/v3/projects/9bbb5023e47c45f49813194c41890827/groups/0ea3d11086ca49b984fe1ddefda79675/roles/ef0525432e044dd18b3ae4b32d29030e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:18:16.796292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fe167-34dc-4593-b687-91ee24940dcd None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:16.796769 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fe167-34dc-4593-b687-91ee24940dcd None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:16.797230 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fe167-34dc-4593-b687-91ee24940dcd None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:16.802683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64112d26-caa8-4d7b-be4f-4478cc89d875 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:16.802683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64112d26-caa8-4d7b-be4f-4478cc89d875 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:16.802683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64112d26-caa8-4d7b-be4f-4478cc89d875 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:16.802683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64112d26-caa8-4d7b-be4f-4478cc89d875 None admin] RBAC: Adding query filter params (name=member) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:16.802683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64112d26-caa8-4d7b-be4f-4478cc89d875 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:16.803858 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 196/391] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:16.804717 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64112d26-caa8-4d7b-be4f-4478cc89d875 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:16.805494 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cfe91-e85b-4b83-8530-a31ff8a44cb8 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:16.805960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cfe91-e85b-4b83-8530-a31ff8a44cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:16.806533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cfe91-e85b-4b83-8530-a31ff8a44cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:16.824889 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 196/392] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:18:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:16.827739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-fe5cfe91-e85b-4b83-8530-a31ff8a44cb8 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:16.829226 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-fe5cfe91-e85b-4b83-8530-a31ff8a44cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:16.830979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64112d26-caa8-4d7b-be4f-4478cc89d875 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:16.908476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 197/393] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:16.997761 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64112d26-caa8-4d7b-be4f-4478cc89d875 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:17.044837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b7a73-5ac2-46b1-bc65-d2d7ee59c4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:17.045495 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b7a73-5ac2-46b1-bc65-d2d7ee59c4dd None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:17.045783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b7a73-5ac2-46b1-bc65-d2d7ee59c4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:17.046044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b7a73-5ac2-46b1-bc65-d2d7ee59c4dd None admin] PATH_INFO: `/v3/groups/0ea3d11086ca49b984fe1ddefda79675` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:17.047264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b7a73-5ac2-46b1-bc65-d2d7ee59c4dd None admin] RBAC: Authorizing `identity:get_group(group_id=0ea3d11086ca49b984fe1ddefda79675)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:17.048790 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b7a73-5ac2-46b1-bc65-d2d7ee59c4dd None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:17.050793 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 197/394] 10.222.0.25 () {56 vars in 1180 bytes} [Sat Sep 24 19:18:16 2022] GET /identity/v3/groups/0ea3d11086ca49b984fe1ddefda79675 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:17.056862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cfe91-e85b-4b83-8530-a31ff8a44cb8 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:17.177217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:17.198886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cfe91-e85b-4b83-8530-a31ff8a44cb8 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:17.235025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b7a73-5ac2-46b1-bc65-d2d7ee59c4dd None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:17.235353 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc57ae5-bfad-4b9c-8bc3-4d4a5fd5e476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:17.236095 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc57ae5-bfad-4b9c-8bc3-4d4a5fd5e476 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:17.236372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc57ae5-bfad-4b9c-8bc3-4d4a5fd5e476 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:17.236644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc57ae5-bfad-4b9c-8bc3-4d4a5fd5e476 None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:17.237758 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc57ae5-bfad-4b9c-8bc3-4d4a5fd5e476 None admin] RBAC: Authorizing `identity:get_project(project_id=54174d12726547b4bb37d9dd5c21798a)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:17.239224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc57ae5-bfad-4b9c-8bc3-4d4a5fd5e476 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:17.240854 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 198/395] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:18:17 2022] GET /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:17.247814 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc57ae5-bfad-4b9c-8bc3-4d4a5fd5e476 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:17.306988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:17.433293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc57ae5-bfad-4b9c-8bc3-4d4a5fd5e476 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:17.447632 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b7a73-5ac2-46b1-bc65-d2d7ee59c4dd None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:17.505709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f13cd7-6450-438f-a96a-169599f37d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:17.506762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f13cd7-6450-438f-a96a-169599f37d0f None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:17.508413 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f13cd7-6450-438f-a96a-169599f37d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:17.508891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f13cd7-6450-438f-a96a-169599f37d0f None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a/groups/0ea3d11086ca49b984fe1ddefda79675/roles/ef0525432e044dd18b3ae4b32d29030e` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:17.512333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f13cd7-6450-438f-a96a-169599f37d0f None admin] RBAC: Authorizing `identity:create_grant(project_id=54174d12726547b4bb37d9dd5c21798a, group_id=0ea3d11086ca49b984fe1ddefda79675, role_id=ef0525432e044dd18b3ae4b32d29030e)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:17.515343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f13cd7-6450-438f-a96a-169599f37d0f None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:17.521879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105a1d3-6b57-4830-a75f-58db5f133378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:17.522784 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105a1d3-6b57-4830-a75f-58db5f133378 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:17.523291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105a1d3-6b57-4830-a75f-58db5f133378 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:17.524019 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105a1d3-6b57-4830-a75f-58db5f133378 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:17.539217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 199/396] 10.222.0.25 () {58 vars in 1442 bytes} [Sat Sep 24 19:18:17 2022] PUT /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a/groups/0ea3d11086ca49b984fe1ddefda79675/roles/ef0525432e044dd18b3ae4b32d29030e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:18:17.540808 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47255d-0b1e-427c-a89c-ec795bd8c2ed None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:17.541302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47255d-0b1e-427c-a89c-ec795bd8c2ed None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:17.541933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47255d-0b1e-427c-a89c-ec795bd8c2ed None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:17.543751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 200/397] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:17.551288 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105a1d3-6b57-4830-a75f-58db5f133378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:17.553148 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad580d0-730a-4ef8-8a1c-45e23d3bafff None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:17.553660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad580d0-730a-4ef8-8a1c-45e23d3bafff None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:17.554139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad580d0-730a-4ef8-8a1c-45e23d3bafff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:17.562885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-9105a1d3-6b57-4830-a75f-58db5f133378 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:18:17.562885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:17.562885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:17.562885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:17.562885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:17.562885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:17.562885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:17.562885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:17.562885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:17.562885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:17.562885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:17.562885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:17.562885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:17.562885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:17.562885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:17.562885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:17.563887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:17.563887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:17.563887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:17.563887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:17.563887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:17.563887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:17.563887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:17.563887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:17.563887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:17.563887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:17.563887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:17.563887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:17.563887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:17.563887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:17.563887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:17.563887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:17.564715 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:17.564715 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:17.564715 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:17.564715 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:17.564715 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:17.564715 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:17.564715 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:17.564715 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:17.564715 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:17.564715 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:17.564715 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:18:17.564715 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:17.564715 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 198/398] 10.222.0.25 () {56 vars in 1114 bytes} [Sat Sep 24 19:18:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:18:17.568604 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105a1d3-6b57-4830-a75f-58db5f133378 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:17.591400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-4ad580d0-730a-4ef8-8a1c-45e23d3bafff None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:17.592599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4ad580d0-730a-4ef8-8a1c-45e23d3bafff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:17.596950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:17.720163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:17.744745 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105a1d3-6b57-4830-a75f-58db5f133378 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:17.758388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 201/399] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:17.793582 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947025a4-7e5a-4094-b929-e68e7874a975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:17.794208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947025a4-7e5a-4094-b929-e68e7874a975 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:17.794487 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947025a4-7e5a-4094-b929-e68e7874a975 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:17.794757 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947025a4-7e5a-4094-b929-e68e7874a975 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:17.795547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947025a4-7e5a-4094-b929-e68e7874a975 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:17.795857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947025a4-7e5a-4094-b929-e68e7874a975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:17.797239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947025a4-7e5a-4094-b929-e68e7874a975 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:17.807020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 199/400] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:17.812897 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad580d0-730a-4ef8-8a1c-45e23d3bafff None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:17.955773 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97867e83-616a-4e81-944e-5d3c304ac24f None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:17.956092 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97867e83-616a-4e81-944e-5d3c304ac24f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:17.956328 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97867e83-616a-4e81-944e-5d3c304ac24f None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:17.957685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 200/401] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:17.971953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad580d0-730a-4ef8-8a1c-45e23d3bafff None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:17.974996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c7568-c9d5-422b-83e0-0f48e961d6a4 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:17.975282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c7568-c9d5-422b-83e0-0f48e961d6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:17.975554 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c7568-c9d5-422b-83e0-0f48e961d6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:17.999228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-b05c7568-c9d5-422b-83e0-0f48e961d6a4 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:18.000633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b05c7568-c9d5-422b-83e0-0f48e961d6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:18.035743 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c73b5b-0ce0-4831-8a2d-a17a7e900fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:18.037368 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c73b5b-0ce0-4831-8a2d-a17a7e900fcd None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:18.037981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c73b5b-0ce0-4831-8a2d-a17a7e900fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:18.038542 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c73b5b-0ce0-4831-8a2d-a17a7e900fcd None admin] PATH_INFO: `/v3/groups/0ea3d11086ca49b984fe1ddefda79675` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:18.043475 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c73b5b-0ce0-4831-8a2d-a17a7e900fcd None admin] RBAC: Authorizing `identity:get_group(group_id=0ea3d11086ca49b984fe1ddefda79675)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:18.046073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c73b5b-0ce0-4831-8a2d-a17a7e900fcd None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:18.047905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 202/402] 10.222.0.25 () {56 vars in 1180 bytes} [Sat Sep 24 19:18:17 2022] GET /identity/v3/groups/0ea3d11086ca49b984fe1ddefda79675 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:18.053435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c73b5b-0ce0-4831-8a2d-a17a7e900fcd None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:18.067876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:18.083804 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 201/403] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:18.177971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c73b5b-0ce0-4831-8a2d-a17a7e900fcd None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:18.188703 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c7568-c9d5-422b-83e0-0f48e961d6a4 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:18.219041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ec03e-d2c4-4e1c-96c2-e5bcba25175d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:18.220189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ec03e-d2c4-4e1c-96c2-e5bcba25175d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:18.220624 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ec03e-d2c4-4e1c-96c2-e5bcba25175d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:18.221066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ec03e-d2c4-4e1c-96c2-e5bcba25175d None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:18.222444 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ec03e-d2c4-4e1c-96c2-e5bcba25175d None admin] RBAC: Authorizing `identity:get_project(project_id=9bbb5023e47c45f49813194c41890827)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:18.224044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ec03e-d2c4-4e1c-96c2-e5bcba25175d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:18.226278 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 203/404] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:18:18 2022] GET /identity/v3/projects/9bbb5023e47c45f49813194c41890827 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:18.232460 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ec03e-d2c4-4e1c-96c2-e5bcba25175d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:18.320329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:18.350757 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ec03e-d2c4-4e1c-96c2-e5bcba25175d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:18.387181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:18.390689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89be8dd-cc68-4596-a53d-e8440ce32974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:18.391528 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89be8dd-cc68-4596-a53d-e8440ce32974 None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:18.391829 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89be8dd-cc68-4596-a53d-e8440ce32974 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:18.392068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89be8dd-cc68-4596-a53d-e8440ce32974 None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827/groups/0ea3d11086ca49b984fe1ddefda79675/roles/655c93c88bc34badbfd2aad45491a96b` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:18.403672 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89be8dd-cc68-4596-a53d-e8440ce32974 None admin] RBAC: Authorizing `identity:create_grant(project_id=9bbb5023e47c45f49813194c41890827, group_id=0ea3d11086ca49b984fe1ddefda79675, role_id=655c93c88bc34badbfd2aad45491a96b)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:18.405145 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89be8dd-cc68-4596-a53d-e8440ce32974 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:18.425875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c7568-c9d5-422b-83e0-0f48e961d6a4 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:18.429440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 204/405] 10.222.0.25 () {58 vars in 1442 bytes} [Sat Sep 24 19:18:18 2022] PUT /identity/v3/projects/9bbb5023e47c45f49813194c41890827/groups/0ea3d11086ca49b984fe1ddefda79675/roles/655c93c88bc34badbfd2aad45491a96b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:18:18.430513 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89be8dd-cc68-4596-a53d-e8440ce32974 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:18.485045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1436078-e6ad-420c-bc2d-e803996a318d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:18.485700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1436078-e6ad-420c-bc2d-e803996a318d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:18.485974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1436078-e6ad-420c-bc2d-e803996a318d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:18.486242 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1436078-e6ad-420c-bc2d-e803996a318d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:18.516720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1436078-e6ad-420c-bc2d-e803996a318d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:18.526185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-f1436078-e6ad-420c-bc2d-e803996a318d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:18:18.526185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:18.526185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:18.526185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:18.526185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:18.526185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:18.526185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:18.526185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:18.526185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:18.526185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:18.526185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:18.526185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:18.526185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:18.526185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:18.526185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:18.526185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:18.527228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:18.527228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:18.527228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:18.527228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:18.527228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:18.527228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:18.527228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:18.527228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:18.527228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:18.527228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:18.527228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:18.527228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:18.527228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:18.527228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:18.527228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:18.527228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:18.528028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:18.528028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:18.528028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:18.528028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:18.528028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:18.528028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:18.528028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:18.528028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:18.528028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:18.528028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:18.528028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:18:18.528028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:18.535561 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 202/406] 10.222.0.25 () {56 vars in 1114 bytes} [Sat Sep 24 19:18:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:18:18.536852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1436078-e6ad-420c-bc2d-e803996a318d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:18.647227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89be8dd-cc68-4596-a53d-e8440ce32974 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:18.694320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1436078-e6ad-420c-bc2d-e803996a318d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:18.703108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4e3fa-3aa3-498c-be93-e0a214f17f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:18.704146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4e3fa-3aa3-498c-be93-e0a214f17f6b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:18.704637 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4e3fa-3aa3-498c-be93-e0a214f17f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:18.705108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4e3fa-3aa3-498c-be93-e0a214f17f6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:18.723239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:18.732512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509d574-5853-4d19-95b1-93b3c7faffcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:18.733119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509d574-5853-4d19-95b1-93b3c7faffcb None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:18.733413 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509d574-5853-4d19-95b1-93b3c7faffcb None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:18.733655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509d574-5853-4d19-95b1-93b3c7faffcb None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:18.734461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509d574-5853-4d19-95b1-93b3c7faffcb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:18.734763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509d574-5853-4d19-95b1-93b3c7faffcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:18.736669 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509d574-5853-4d19-95b1-93b3c7faffcb None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:18.737678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4e3fa-3aa3-498c-be93-e0a214f17f6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:18.744291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-5fa4e3fa-3aa3-498c-be93-e0a214f17f6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:18:18.744291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:18.744291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:18.744291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:18.744291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:18.744291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:18.744291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:18.744291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:18.744291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:18.744291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:18.744291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:18.744291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:18.744291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:18.744291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:18.744291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:18.744291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:18.745220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:18.745220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:18.745220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:18.745220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:18.745220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:18.745220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:18.745220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:18.745220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:18.745220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:18.745220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:18.745220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:18.745220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:18.745220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:18.745220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:18.745220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:18.745220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:18.746006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:18.746006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:18.746006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:18.746006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:18.746006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:18.746006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:18.746006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:18.746006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:18.746006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:18.746006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:18.746006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:18:18.746006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:18.746006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 205/408] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:18:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:18.746664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 203/408] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:18.751869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4e3fa-3aa3-498c-be93-e0a214f17f6b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:18.753147 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509d574-5853-4d19-95b1-93b3c7faffcb None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:18.771595 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:18.878056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4e3fa-3aa3-498c-be93-e0a214f17f6b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:18.915441 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca1023-fd5d-479d-809f-9050a943eb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:18.916111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca1023-fd5d-479d-809f-9050a943eb1d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:18.916396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca1023-fd5d-479d-809f-9050a943eb1d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:18.917289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca1023-fd5d-479d-809f-9050a943eb1d None admin] PATH_INFO: `/v3/groups/0ea3d11086ca49b984fe1ddefda79675` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:18.918440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca1023-fd5d-479d-809f-9050a943eb1d None admin] RBAC: Authorizing `identity:get_group(group_id=0ea3d11086ca49b984fe1ddefda79675)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:18.920115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca1023-fd5d-479d-809f-9050a943eb1d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:18.921935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 206/409] 10.222.0.25 () {56 vars in 1180 bytes} [Sat Sep 24 19:18:18 2022] GET /identity/v3/groups/0ea3d11086ca49b984fe1ddefda79675 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:18.927221 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca1023-fd5d-479d-809f-9050a943eb1d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:19.018622 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509d574-5853-4d19-95b1-93b3c7faffcb None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:19.030925 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:19.091005 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c71b74-f0b4-48c9-af5c-069c1b00172d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:19.091992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c71b74-f0b4-48c9-af5c-069c1b00172d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:19.092462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c71b74-f0b4-48c9-af5c-069c1b00172d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:19.092934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c71b74-f0b4-48c9-af5c-069c1b00172d None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:19.093772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c71b74-f0b4-48c9-af5c-069c1b00172d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:19.094288 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c71b74-f0b4-48c9-af5c-069c1b00172d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:19.097273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c71b74-f0b4-48c9-af5c-069c1b00172d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:19.109541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca1023-fd5d-479d-809f-9050a943eb1d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:19.120521 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 204/410] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:19.126176 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c71b74-f0b4-48c9-af5c-069c1b00172d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:19.198274 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92513156-098a-4260-95ec-07778e318d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:19.198946 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92513156-098a-4260-95ec-07778e318d66 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:19.199227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92513156-098a-4260-95ec-07778e318d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:19.199500 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92513156-098a-4260-95ec-07778e318d66 None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:19.199934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:19.203529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92513156-098a-4260-95ec-07778e318d66 None admin] RBAC: Authorizing `identity:get_project(project_id=54174d12726547b4bb37d9dd5c21798a)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:19.204970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92513156-098a-4260-95ec-07778e318d66 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:19.206938 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 207/411] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:18:18 2022] GET /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:19.212489 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92513156-098a-4260-95ec-07778e318d66 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:19.243327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c71b74-f0b4-48c9-af5c-069c1b00172d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:19.280308 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd43591-f792-4365-85a7-7afb895425b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:19.280862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd43591-f792-4365-85a7-7afb895425b7 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:19.281148 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd43591-f792-4365-85a7-7afb895425b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:19.281423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd43591-f792-4365-85a7-7afb895425b7 None admin] PATH_INFO: `/v3/groups/709615f3b52442ee95936e1597777228` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:19.282744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd43591-f792-4365-85a7-7afb895425b7 None admin] RBAC: Authorizing `identity:get_group(group_id=709615f3b52442ee95936e1597777228)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:19.284441 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd43591-f792-4365-85a7-7afb895425b7 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:19.286143 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 205/412] 10.222.0.25 () {56 vars in 1180 bytes} [Sat Sep 24 19:18:19 2022] GET /identity/v3/groups/709615f3b52442ee95936e1597777228 => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:19.291728 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd43591-f792-4365-85a7-7afb895425b7 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:19.436232 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd43591-f792-4365-85a7-7afb895425b7 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:19.460168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92513156-098a-4260-95ec-07778e318d66 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:19.495431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:19.499699 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:19.505949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04860d5-927f-4b06-a882-60ab459167cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:19.506100 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3cd0c-9edc-47d1-bcfb-97eb69d2038e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:19.506634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04860d5-927f-4b06-a882-60ab459167cf None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:19.506741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3cd0c-9edc-47d1-bcfb-97eb69d2038e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:19.506940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04860d5-927f-4b06-a882-60ab459167cf None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:19.507035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3cd0c-9edc-47d1-bcfb-97eb69d2038e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:19.507216 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04860d5-927f-4b06-a882-60ab459167cf None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a/groups/0ea3d11086ca49b984fe1ddefda79675/roles/655c93c88bc34badbfd2aad45491a96b` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:19.507315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3cd0c-9edc-47d1-bcfb-97eb69d2038e None admin] PATH_INFO: `/v3/projects/80330a20cbd94abd8d12b2c485818669` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:19.508423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3cd0c-9edc-47d1-bcfb-97eb69d2038e None admin] RBAC: Authorizing `identity:get_project(project_id=80330a20cbd94abd8d12b2c485818669)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:19.509397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04860d5-927f-4b06-a882-60ab459167cf None admin] RBAC: Authorizing `identity:create_grant(project_id=54174d12726547b4bb37d9dd5c21798a, group_id=0ea3d11086ca49b984fe1ddefda79675, role_id=655c93c88bc34badbfd2aad45491a96b)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:19.509850 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3cd0c-9edc-47d1-bcfb-97eb69d2038e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:19.511382 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04860d5-927f-4b06-a882-60ab459167cf None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:19.512575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 206/413] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:18:19 2022] GET /identity/v3/projects/80330a20cbd94abd8d12b2c485818669 => generated 344 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:19.513734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756418d-cace-4062-b543-82eda2787efc None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:19.514008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756418d-cace-4062-b543-82eda2787efc None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:19.514276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756418d-cace-4062-b543-82eda2787efc None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:19.515647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 207/414] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:19.520243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756418d-cace-4062-b543-82eda2787efc None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:19.533711 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 208/415] 10.222.0.25 () {58 vars in 1442 bytes} [Sat Sep 24 19:18:19 2022] PUT /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a/groups/0ea3d11086ca49b984fe1ddefda79675/roles/655c93c88bc34badbfd2aad45491a96b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:18:19.535117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b35164-fc0a-42d3-a488-b6e4b83fdbc2 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:19.535411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b35164-fc0a-42d3-a488-b6e4b83fdbc2 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:19.535692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b35164-fc0a-42d3-a488-b6e4b83fdbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:19.561255 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-d5b35164-fc0a-42d3-a488-b6e4b83fdbc2 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:19.563503 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d5b35164-fc0a-42d3-a488-b6e4b83fdbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:19.693464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756418d-cace-4062-b543-82eda2787efc None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:19.720474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 209/416] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:19.735399 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0356e81-510e-4d6a-a114-9657ee126f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:19.736084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0356e81-510e-4d6a-a114-9657ee126f12 None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:19.736361 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0356e81-510e-4d6a-a114-9657ee126f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:19.736635 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0356e81-510e-4d6a-a114-9657ee126f12 None admin] PATH_INFO: `/v3/projects/80330a20cbd94abd8d12b2c485818669/groups/709615f3b52442ee95936e1597777228/roles/dd27845a836a4f6ebece149dbebc59c0` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:19.738859 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0356e81-510e-4d6a-a114-9657ee126f12 None admin] RBAC: Authorizing `identity:create_grant(project_id=80330a20cbd94abd8d12b2c485818669, group_id=709615f3b52442ee95936e1597777228, role_id=dd27845a836a4f6ebece149dbebc59c0)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:19.740460 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0356e81-510e-4d6a-a114-9657ee126f12 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:19.756160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 208/417] 10.222.0.25 () {58 vars in 1442 bytes} [Sat Sep 24 19:18:19 2022] PUT /identity/v3/projects/80330a20cbd94abd8d12b2c485818669/groups/709615f3b52442ee95936e1597777228/roles/dd27845a836a4f6ebece149dbebc59c0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:18:20.059406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b35164-fc0a-42d3-a488-b6e4b83fdbc2 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:20.085141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42bae2-4023-44f7-9594-43c6a05e5fac None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:20.085773 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42bae2-4023-44f7-9594-43c6a05e5fac None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:20.085773 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42bae2-4023-44f7-9594-43c6a05e5fac None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:20.087173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 209/418] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:18:20.094306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266d341-30a2-4508-9adf-016c53cd9526 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:20.094713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266d341-30a2-4508-9adf-016c53cd9526 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:20.095121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266d341-30a2-4508-9adf-016c53cd9526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:20.124455 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-a266d341-30a2-4508-9adf-016c53cd9526 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:20.126052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a266d341-30a2-4508-9adf-016c53cd9526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:20.205725 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b35164-fc0a-42d3-a488-b6e4b83fdbc2 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:20.232310 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:20.235265 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:20.252330 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 210/419] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:18:20.258108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebca01c-4ad4-4985-a266-600dd52d6381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:20.258741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebca01c-4ad4-4985-a266-600dd52d6381 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:20.259052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebca01c-4ad4-4985-a266-600dd52d6381 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:20.259323 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebca01c-4ad4-4985-a266-600dd52d6381 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:20.270271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebca01c-4ad4-4985-a266-600dd52d6381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:20.275448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-5ebca01c-4ad4-4985-a266-600dd52d6381 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:18:20.275448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:20.275448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:20.275448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:20.275448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:20.275448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:20.275448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:20.275448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:20.275448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:20.275448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:20.275448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:20.275448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:20.275448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:20.275448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:20.275448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:20.275448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:20.276589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:20.276589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:20.276589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:20.276589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:20.276589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:20.276589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:20.276589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:20.276589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:20.276589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:20.276589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:20.276589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:20.276589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:20.276589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:20.276589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:20.276589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:20.276589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:20.277606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:20.277606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:20.277606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:20.277606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:20.277606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:20.277606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:20.277606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:20.277606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:20.277606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:20.277606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:20.277606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:18:20.277606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:20.281482 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 210/420] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:20.282817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266d341-30a2-4508-9adf-016c53cd9526 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:20.447076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266d341-30a2-4508-9adf-016c53cd9526 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:20.498581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7ea3e-8cf3-446b-b1b6-73e31ec04cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:20.499505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7ea3e-8cf3-446b-b1b6-73e31ec04cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:20.499959 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7ea3e-8cf3-446b-b1b6-73e31ec04cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:20.500400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7ea3e-8cf3-446b-b1b6-73e31ec04cb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:20.501252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7ea3e-8cf3-446b-b1b6-73e31ec04cb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:20.501728 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7ea3e-8cf3-446b-b1b6-73e31ec04cb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:20.503292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7ea3e-8cf3-446b-b1b6-73e31ec04cb9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:20.512417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 211/421] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:18:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:20.518331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebca01c-4ad4-4985-a266-600dd52d6381 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:20.612333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7ea3e-8cf3-446b-b1b6-73e31ec04cb9 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:20.717712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:20.733720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebca01c-4ad4-4985-a266-600dd52d6381 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:20.774923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7ea3e-8cf3-446b-b1b6-73e31ec04cb9 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:20.813456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133ec4a-bf6f-4f8a-a221-f21d66c620e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:20.814438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133ec4a-bf6f-4f8a-a221-f21d66c620e8 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:20.814962 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133ec4a-bf6f-4f8a-a221-f21d66c620e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:20.815453 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133ec4a-bf6f-4f8a-a221-f21d66c620e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:20.815557 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20355cb6-93ec-4088-889e-0e3e114f0368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:20.816133 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20355cb6-93ec-4088-889e-0e3e114f0368 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:20.816599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20355cb6-93ec-4088-889e-0e3e114f0368 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:20.817007 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20355cb6-93ec-4088-889e-0e3e114f0368 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:20.828970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20355cb6-93ec-4088-889e-0e3e114f0368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:20.834556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-20355cb6-93ec-4088-889e-0e3e114f0368 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:18:20.834556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:20.834556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:20.834556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:20.834556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:20.834556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:20.834556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:20.834556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:20.834556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:20.834556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:20.834556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:20.834556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:20.834556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:20.834556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:20.834556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:20.834556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:20.835525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:20.835525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:20.835525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:20.835525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:20.835525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:20.835525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:20.835525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:20.835525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:20.835525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:20.835525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:20.835525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:20.835525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:20.835525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:20.835525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:20.835525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:20.835525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:20.836342 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:20.836342 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:20.836342 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:20.836342 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:20.836342 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:20.836342 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:20.836342 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:20.836342 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:20.836342 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:20.836342 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:20.836342 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:18:20.836342 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:20.839443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 212/422] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:18:20.845349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20355cb6-93ec-4088-889e-0e3e114f0368 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:20.928353 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:20.949938 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133ec4a-bf6f-4f8a-a221-f21d66c620e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:20.951443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133ec4a-bf6f-4f8a-a221-f21d66c620e8 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:20.965361 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20355cb6-93ec-4088-889e-0e3e114f0368 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:20.980734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:21.005457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33a0fa-2e0e-412f-bab6-b0d08392b343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:21.006465 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33a0fa-2e0e-412f-bab6-b0d08392b343 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:21.006981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33a0fa-2e0e-412f-bab6-b0d08392b343 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:21.007451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33a0fa-2e0e-412f-bab6-b0d08392b343 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:21.008335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33a0fa-2e0e-412f-bab6-b0d08392b343 None admin] RBAC: Adding query filter params (name=member) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:21.008885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33a0fa-2e0e-412f-bab6-b0d08392b343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:21.011306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33a0fa-2e0e-412f-bab6-b0d08392b343 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:21.020872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 213/423] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:18:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:21.027363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4f0bc-9761-4f38-b222-a99a5d891c5f None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:21.027901 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4f0bc-9761-4f38-b222-a99a5d891c5f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:21.028374 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4f0bc-9761-4f38-b222-a99a5d891c5f None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:21.029952 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 214/424] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:21.030852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4f0bc-9761-4f38-b222-a99a5d891c5f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:21.056888 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 211/425] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:18:21.058305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e875-4f41-484b-9e53-7597066eaf7d None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:21.058659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e875-4f41-484b-9e53-7597066eaf7d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:21.058978 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e875-4f41-484b-9e53-7597066eaf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:21.077815 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-0764e875-4f41-484b-9e53-7597066eaf7d None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:21.079167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-0764e875-4f41-484b-9e53-7597066eaf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:21.149494 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4f0bc-9761-4f38-b222-a99a5d891c5f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:21.155158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 212/426] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:21.156660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764e875-4f41-484b-9e53-7597066eaf7d None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:21.173513 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:21.192657 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e05903-c125-42ff-9074-e2887dc8cb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:21.193605 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e05903-c125-42ff-9074-e2887dc8cb53 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:21.194206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e05903-c125-42ff-9074-e2887dc8cb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:21.194775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e05903-c125-42ff-9074-e2887dc8cb53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:21.242873 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:21.266677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764e875-4f41-484b-9e53-7597066eaf7d None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:21.274776 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e05903-c125-42ff-9074-e2887dc8cb53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:21.277579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e05903-c125-42ff-9074-e2887dc8cb53 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:21.302592 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b725f5-51c2-410a-b276-62b30a8fe284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:21.303243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b725f5-51c2-410a-b276-62b30a8fe284 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:21.303517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b725f5-51c2-410a-b276-62b30a8fe284 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:21.303785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b725f5-51c2-410a-b276-62b30a8fe284 None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:21.304982 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b725f5-51c2-410a-b276-62b30a8fe284 None admin] RBAC: Authorizing `identity:get_project(project_id=9bbb5023e47c45f49813194c41890827)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:21.306326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b725f5-51c2-410a-b276-62b30a8fe284 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:21.309054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 213/427] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:18:21 2022] GET /identity/v3/projects/9bbb5023e47c45f49813194c41890827 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:21.319693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b725f5-51c2-410a-b276-62b30a8fe284 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:21.393543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 215/428] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:18:21.399743 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e05903-c125-42ff-9074-e2887dc8cb53 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:21.468215 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:21.484585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:21.503764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b725f5-51c2-410a-b276-62b30a8fe284 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:21.514500 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e05903-c125-42ff-9074-e2887dc8cb53 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:21.540431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a05ec-aa79-4efb-b770-bebae6b7f56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:21.541059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a05ec-aa79-4efb-b770-bebae6b7f56c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:21.541333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a05ec-aa79-4efb-b770-bebae6b7f56c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:21.541900 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a05ec-aa79-4efb-b770-bebae6b7f56c None admin] PATH_INFO: `/v3/groups/0ea3d11086ca49b984fe1ddefda79675` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:21.543295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a05ec-aa79-4efb-b770-bebae6b7f56c None admin] RBAC: Authorizing `identity:get_group(group_id=0ea3d11086ca49b984fe1ddefda79675)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:21.544726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a05ec-aa79-4efb-b770-bebae6b7f56c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:21.546346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 214/429] 10.222.0.25 () {56 vars in 1180 bytes} [Sat Sep 24 19:18:21 2022] GET /identity/v3/groups/0ea3d11086ca49b984fe1ddefda79675 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:21.547054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a05ec-aa79-4efb-b770-bebae6b7f56c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:21.554263 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a922879-6fd3-476a-947e-23a8fe8384df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:21.555120 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a922879-6fd3-476a-947e-23a8fe8384df None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:21.555671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a922879-6fd3-476a-947e-23a8fe8384df None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:21.556087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a922879-6fd3-476a-947e-23a8fe8384df None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:21.557540 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a922879-6fd3-476a-947e-23a8fe8384df None admin] RBAC: Authorizing `identity:get_project(project_id=54174d12726547b4bb37d9dd5c21798a)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:21.559261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a922879-6fd3-476a-947e-23a8fe8384df None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:21.561354 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 216/430] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:18:21 2022] GET /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:21.566974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a922879-6fd3-476a-947e-23a8fe8384df None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:21.651837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a05ec-aa79-4efb-b770-bebae6b7f56c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:21.678213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a922879-6fd3-476a-947e-23a8fe8384df None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:21.687355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8319cb-8df0-4e26-a202-941dd7084e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:21.687981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8319cb-8df0-4e26-a202-941dd7084e2b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:21.688255 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8319cb-8df0-4e26-a202-941dd7084e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:21.688520 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8319cb-8df0-4e26-a202-941dd7084e2b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:21.700086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8319cb-8df0-4e26-a202-941dd7084e2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:21.704875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-7a8319cb-8df0-4e26-a202-941dd7084e2b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:18:21.704875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:21.704875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:21.704875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:21.704875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:21.704875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:21.704875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:21.704875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:21.704875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:21.704875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:21.704875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:21.704875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:21.704875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:21.704875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:21.704875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:21.704875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:21.705985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:21.705985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:21.705985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:21.705985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:21.705985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:21.705985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:21.705985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:21.705985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:21.705985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:21.705985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:21.705985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:21.705985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:21.705985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:21.705985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:21.705985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:21.705985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:21.706809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:21.706809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:21.706809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:21.706809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:21.706809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:21.706809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:21.706809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:21.706809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:21.706809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:21.706809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:21.706809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:18:21.706809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:21.706809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 215/431] 10.222.0.25 () {56 vars in 1114 bytes} [Sat Sep 24 19:18:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:21.707521 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8319cb-8df0-4e26-a202-941dd7084e2b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:21.716288 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:21.722260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47941e-2546-4f69-9449-0c30136c2792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:21.723227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47941e-2546-4f69-9449-0c30136c2792 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:21.723711 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47941e-2546-4f69-9449-0c30136c2792 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:21.724238 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47941e-2546-4f69-9449-0c30136c2792 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:21.725133 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47941e-2546-4f69-9449-0c30136c2792 None admin] RBAC: Adding query filter params (group.id=0ea3d11086ca49b984fe1ddefda79675, role.id=ef0525432e044dd18b3ae4b32d29030e, scope.project.id=9bbb5023e47c45f49813194c41890827) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:21.725615 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47941e-2546-4f69-9449-0c30136c2792 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:21.727458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47941e-2546-4f69-9449-0c30136c2792 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:21.735679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 217/432] 10.222.0.25 () {56 vars in 1376 bytes} [Sat Sep 24 19:18:21 2022] GET /identity/v3/role_assignments?group.id=0ea3d11086ca49b984fe1ddefda79675&scope.project.id=9bbb5023e47c45f49813194c41890827&role.id=ef0525432e044dd18b3ae4b32d29030e => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:21.736740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47941e-2546-4f69-9449-0c30136c2792 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:21.747897 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:21.822689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8319cb-8df0-4e26-a202-941dd7084e2b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:21.859213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47941e-2546-4f69-9449-0c30136c2792 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:21.860336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2410962-c730-4386-909e-59685b48dfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:21.861005 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2410962-c730-4386-909e-59685b48dfb1 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:21.861263 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2410962-c730-4386-909e-59685b48dfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:21.861539 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2410962-c730-4386-909e-59685b48dfb1 None admin] PATH_INFO: `/v3/groups/0ea3d11086ca49b984fe1ddefda79675` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:21.862786 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2410962-c730-4386-909e-59685b48dfb1 None admin] RBAC: Authorizing `identity:get_group(group_id=0ea3d11086ca49b984fe1ddefda79675)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:21.864366 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2410962-c730-4386-909e-59685b48dfb1 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:21.865880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 216/433] 10.222.0.25 () {56 vars in 1180 bytes} [Sat Sep 24 19:18:21 2022] GET /identity/v3/groups/0ea3d11086ca49b984fe1ddefda79675 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:21.877776 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2410962-c730-4386-909e-59685b48dfb1 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:21.909031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5742335-0c24-4d49-82d0-f6ac0e275053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:21.910029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5742335-0c24-4d49-82d0-f6ac0e275053 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:21.910554 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5742335-0c24-4d49-82d0-f6ac0e275053 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:21.911136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5742335-0c24-4d49-82d0-f6ac0e275053 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:21.912005 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5742335-0c24-4d49-82d0-f6ac0e275053 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:21.912508 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5742335-0c24-4d49-82d0-f6ac0e275053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:21.914124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5742335-0c24-4d49-82d0-f6ac0e275053 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:21.925000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 218/434] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:21.930586 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5742335-0c24-4d49-82d0-f6ac0e275053 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:22.014936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:22.023999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:22.054448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2410962-c730-4386-909e-59685b48dfb1 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:22.057925 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5742335-0c24-4d49-82d0-f6ac0e275053 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:22.094682 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b8bfb-b89a-455b-8a3a-60d964b4008f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:22.095240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b8bfb-b89a-455b-8a3a-60d964b4008f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:22.095517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b8bfb-b89a-455b-8a3a-60d964b4008f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:22.095783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b8bfb-b89a-455b-8a3a-60d964b4008f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:22.096504 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b8bfb-b89a-455b-8a3a-60d964b4008f None admin] RBAC: Adding query filter params (group.id=0ea3d11086ca49b984fe1ddefda79675, role.id=ef0525432e044dd18b3ae4b32d29030e, scope.project.id=54174d12726547b4bb37d9dd5c21798a) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:22.096806 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b8bfb-b89a-455b-8a3a-60d964b4008f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:22.098217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b8bfb-b89a-455b-8a3a-60d964b4008f None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:22.098631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f1a56-ad9c-4040-8a0e-7edc24531135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:22.099285 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f1a56-ad9c-4040-8a0e-7edc24531135 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:22.099568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f1a56-ad9c-4040-8a0e-7edc24531135 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:22.099944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f1a56-ad9c-4040-8a0e-7edc24531135 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:22.104850 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 217/435] 10.222.0.25 () {56 vars in 1376 bytes} [Sat Sep 24 19:18:21 2022] GET /identity/v3/role_assignments?group.id=0ea3d11086ca49b984fe1ddefda79675&scope.project.id=54174d12726547b4bb37d9dd5c21798a&role.id=ef0525432e044dd18b3ae4b32d29030e => generated 611 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:22.190242 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f1a56-ad9c-4040-8a0e-7edc24531135 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:22.191783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f1a56-ad9c-4040-8a0e-7edc24531135 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:22.267319 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:22.268896 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c748193-1a0a-43a5-b76a-b09f9ac39e4a None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:22.269240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c748193-1a0a-43a5-b76a-b09f9ac39e4a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:22.269504 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c748193-1a0a-43a5-b76a-b09f9ac39e4a None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:22.274757 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 218/436] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:18:22.284934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ca8eb-0e8f-4c55-bffa-97a58e8d3efc None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:22.285237 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ca8eb-0e8f-4c55-bffa-97a58e8d3efc None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:22.285489 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ca8eb-0e8f-4c55-bffa-97a58e8d3efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:22.316515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 219/437] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:18:22.317585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-c03ca8eb-0e8f-4c55-bffa-97a58e8d3efc None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:22.318841 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c03ca8eb-0e8f-4c55-bffa-97a58e8d3efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:22.322083 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f1a56-ad9c-4040-8a0e-7edc24531135 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:22.422102 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 219/438] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:18:22.474251 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f1a56-ad9c-4040-8a0e-7edc24531135 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:22.517331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82651ec-80e6-4e0b-969a-e73fb43537d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:22.518030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82651ec-80e6-4e0b-969a-e73fb43537d6 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:22.518315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82651ec-80e6-4e0b-969a-e73fb43537d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:22.518700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82651ec-80e6-4e0b-969a-e73fb43537d6 None admin] PATH_INFO: `/v3/projects/9bbb5023e47c45f49813194c41890827` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:22.519870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82651ec-80e6-4e0b-969a-e73fb43537d6 None admin] RBAC: Authorizing `identity:get_project(project_id=9bbb5023e47c45f49813194c41890827)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:22.521335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82651ec-80e6-4e0b-969a-e73fb43537d6 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:22.523351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 220/439] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:18:22 2022] GET /identity/v3/projects/9bbb5023e47c45f49813194c41890827 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:22.528957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ca8eb-0e8f-4c55-bffa-97a58e8d3efc None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:22.601061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:22.607823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd0923-599b-4ba0-9bea-81093c0d9980 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:22.608107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd0923-599b-4ba0-9bea-81093c0d9980 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:22.608378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd0923-599b-4ba0-9bea-81093c0d9980 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:22.609863 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 221/440] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:18:22.615264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdfaa4-42c0-437f-b008-b8c08cfb0bfd None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:22.615548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdfaa4-42c0-437f-b008-b8c08cfb0bfd None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:22.616189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdfaa4-42c0-437f-b008-b8c08cfb0bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:22.634547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-c3cdfaa4-42c0-437f-b008-b8c08cfb0bfd None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:22.635809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c3cdfaa4-42c0-437f-b008-b8c08cfb0bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:22.640027 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ca8eb-0e8f-4c55-bffa-97a58e8d3efc None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:22.664318 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:22.678715 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d91bf8-5876-4441-95f9-311b4ab6fa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:22.679754 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d91bf8-5876-4441-95f9-311b4ab6fa1e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:22.680024 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d91bf8-5876-4441-95f9-311b4ab6fa1e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:22.680302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d91bf8-5876-4441-95f9-311b4ab6fa1e None admin] PATH_INFO: `/v3/groups/0ea3d11086ca49b984fe1ddefda79675` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:22.681767 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d91bf8-5876-4441-95f9-311b4ab6fa1e None admin] RBAC: Authorizing `identity:get_group(group_id=0ea3d11086ca49b984fe1ddefda79675)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:22.684120 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d91bf8-5876-4441-95f9-311b4ab6fa1e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:22.690516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 220/441] 10.222.0.25 () {56 vars in 1180 bytes} [Sat Sep 24 19:18:22 2022] GET /identity/v3/groups/0ea3d11086ca49b984fe1ddefda79675 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:22.691444 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d91bf8-5876-4441-95f9-311b4ab6fa1e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:22.711235 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 222/442] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:18:22.712769 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdfaa4-42c0-437f-b008-b8c08cfb0bfd None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:22.804697 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d91bf8-5876-4441-95f9-311b4ab6fa1e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:22.817117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdfaa4-42c0-437f-b008-b8c08cfb0bfd None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:22.839741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cdd96-b394-4774-b217-ead8ec9376f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:22.840369 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cdd96-b394-4774-b217-ead8ec9376f3 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:22.840631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cdd96-b394-4774-b217-ead8ec9376f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:22.840891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cdd96-b394-4774-b217-ead8ec9376f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:22.841597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cdd96-b394-4774-b217-ead8ec9376f3 None admin] RBAC: Adding query filter params (group.id=0ea3d11086ca49b984fe1ddefda79675, role.id=655c93c88bc34badbfd2aad45491a96b, scope.project.id=9bbb5023e47c45f49813194c41890827) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:22.841908 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cdd96-b394-4774-b217-ead8ec9376f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:22.843362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cdd96-b394-4774-b217-ead8ec9376f3 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:22.846650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:22.854629 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c62da-888a-47f0-acbc-1689ebf39349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:22.855521 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c62da-888a-47f0-acbc-1689ebf39349 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:22.855808 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c62da-888a-47f0-acbc-1689ebf39349 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:22.856078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c62da-888a-47f0-acbc-1689ebf39349 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:22.859471 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 221/443] 10.222.0.25 () {56 vars in 1376 bytes} [Sat Sep 24 19:18:22 2022] GET /identity/v3/role_assignments?group.id=0ea3d11086ca49b984fe1ddefda79675&scope.project.id=9bbb5023e47c45f49813194c41890827&role.id=655c93c88bc34badbfd2aad45491a96b => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:22.868402 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c62da-888a-47f0-acbc-1689ebf39349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:22.873692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-ef4c62da-888a-47f0-acbc-1689ebf39349 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:18:22.873692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:22.873692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:22.873692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:22.873692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:22.873692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:22.873692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:22.873692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:22.873692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:22.873692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:22.873692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:22.873692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:22.873692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:22.873692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:22.873692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:22.873692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:22.874665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:22.874665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:22.874665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:22.874665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:22.874665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:22.874665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:22.874665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:22.874665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:22.874665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:22.874665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:22.874665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:22.874665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:22.874665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:22.874665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:22.874665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:22.874665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:22.875519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:22.875519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:22.875519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:22.875519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:22.875519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:22.875519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:22.875519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:22.875519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:22.875519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:22.875519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:22.875519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:18:22.875519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:22.880028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 223/444] 10.222.0.25 () {56 vars in 1114 bytes} [Sat Sep 24 19:18:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:18:22.881116 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cdd96-b394-4774-b217-ead8ec9376f3 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:22.986328 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c62da-888a-47f0-acbc-1689ebf39349 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:22.997004 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cdd96-b394-4774-b217-ead8ec9376f3 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:23.019892 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:23.046485 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b0187-3572-4463-8120-7ea9c2707a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:23.047138 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b0187-3572-4463-8120-7ea9c2707a48 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:23.047419 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b0187-3572-4463-8120-7ea9c2707a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:23.047693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b0187-3572-4463-8120-7ea9c2707a48 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:23.049142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b0187-3572-4463-8120-7ea9c2707a48 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:23.049142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b0187-3572-4463-8120-7ea9c2707a48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:23.050887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b0187-3572-4463-8120-7ea9c2707a48 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:23.065159 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 222/445] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:23.066444 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b0187-3572-4463-8120-7ea9c2707a48 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:23.107910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c62da-888a-47f0-acbc-1689ebf39349 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:23.141234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:23.149245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0570bdc-b6c4-41b5-a114-8ccfdc5f8fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:23.149903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0570bdc-b6c4-41b5-a114-8ccfdc5f8fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:23.150155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0570bdc-b6c4-41b5-a114-8ccfdc5f8fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:23.150420 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0570bdc-b6c4-41b5-a114-8ccfdc5f8fb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:23.161448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0570bdc-b6c4-41b5-a114-8ccfdc5f8fb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:23.166258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-b0570bdc-b6c4-41b5-a114-8ccfdc5f8fb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:18:23.166258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:23.166258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:23.166258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:23.166258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:23.166258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:23.166258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:23.166258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:23.166258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:23.166258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:23.166258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:23.166258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:23.166258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:23.166258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:23.166258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:23.166258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:23.167837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:23.167837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:23.167837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:23.167837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:23.167837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:23.167837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:23.167837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:23.167837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:23.167837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:23.167837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:23.167837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:23.167837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:23.167837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:23.167837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:23.167837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:23.167837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:23.169114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:23.169114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:23.169114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:23.169114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:23.169114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:23.169114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:23.169114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:23.169114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:23.169114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:23.169114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:23.169114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:18:23.169114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:23.169114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 224/446] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:18:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:18:23.174245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0570bdc-b6c4-41b5-a114-8ccfdc5f8fb8 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:23.188701 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b0187-3572-4463-8120-7ea9c2707a48 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:23.225222 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8c7bd-c35b-4e9f-bd70-b2be7531eb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:23.225838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8c7bd-c35b-4e9f-bd70-b2be7531eb47 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:23.226115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8c7bd-c35b-4e9f-bd70-b2be7531eb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:23.226385 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8c7bd-c35b-4e9f-bd70-b2be7531eb47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:23.274993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:23.290943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0570bdc-b6c4-41b5-a114-8ccfdc5f8fb8 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:23.304955 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8c7bd-c35b-4e9f-bd70-b2be7531eb47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:23.306422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8c7bd-c35b-4e9f-bd70-b2be7531eb47 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:23.334635 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e47c1-904d-4e58-bd08-66b88187ceb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:23.335453 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e47c1-904d-4e58-bd08-66b88187ceb3 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:23.336076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e47c1-904d-4e58-bd08-66b88187ceb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:23.336356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e47c1-904d-4e58-bd08-66b88187ceb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:23.337184 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e47c1-904d-4e58-bd08-66b88187ceb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:23.337492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e47c1-904d-4e58-bd08-66b88187ceb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:23.339840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e47c1-904d-4e58-bd08-66b88187ceb3 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:23.350918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 225/447] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:23.356081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e47c1-904d-4e58-bd08-66b88187ceb3 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:23.377110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:23.437248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 223/448] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 19:18:23.442822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8c7bd-c35b-4e9f-bd70-b2be7531eb47 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:23.477604 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e47c1-904d-4e58-bd08-66b88187ceb3 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:23.511488 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f479f-523e-4852-8067-7a3f2b8db744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:23.512089 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f479f-523e-4852-8067-7a3f2b8db744 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:23.512363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f479f-523e-4852-8067-7a3f2b8db744 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:23.512631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f479f-523e-4852-8067-7a3f2b8db744 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:23.532231 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:23.541235 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8c7bd-c35b-4e9f-bd70-b2be7531eb47 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:23.576320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13c2d8-3f76-4537-a474-0c7207b1de56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:23.576947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13c2d8-3f76-4537-a474-0c7207b1de56 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:23.577228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13c2d8-3f76-4537-a474-0c7207b1de56 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:23.577501 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13c2d8-3f76-4537-a474-0c7207b1de56 None admin] PATH_INFO: `/v3/projects/54174d12726547b4bb37d9dd5c21798a` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:23.578624 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13c2d8-3f76-4537-a474-0c7207b1de56 None admin] RBAC: Authorizing `identity:get_project(project_id=54174d12726547b4bb37d9dd5c21798a)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:23.580106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13c2d8-3f76-4537-a474-0c7207b1de56 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:23.581731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 224/449] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:18:23 2022] GET /identity/v3/projects/54174d12726547b4bb37d9dd5c21798a => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:23.582496 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f479f-523e-4852-8067-7a3f2b8db744 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:23.584108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f479f-523e-4852-8067-7a3f2b8db744 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:23.587134 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13c2d8-3f76-4537-a474-0c7207b1de56 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:23.615986 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:23.682718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 226/450] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 19:18:23.685313 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13c2d8-3f76-4537-a474-0c7207b1de56 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:23.688454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f479f-523e-4852-8067-7a3f2b8db744 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:23.719580 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fe4ca-94d5-4cf1-abb1-c0d4cb3a0f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:23.720205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fe4ca-94d5-4cf1-abb1-c0d4cb3a0f63 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:23.720489 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fe4ca-94d5-4cf1-abb1-c0d4cb3a0f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:23.720764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fe4ca-94d5-4cf1-abb1-c0d4cb3a0f63 None admin] PATH_INFO: `/v3/groups/0ea3d11086ca49b984fe1ddefda79675` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:23.721889 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fe4ca-94d5-4cf1-abb1-c0d4cb3a0f63 None admin] RBAC: Authorizing `identity:get_group(group_id=0ea3d11086ca49b984fe1ddefda79675)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:23.723376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fe4ca-94d5-4cf1-abb1-c0d4cb3a0f63 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:23.724931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 225/451] 10.222.0.25 () {56 vars in 1180 bytes} [Sat Sep 24 19:18:23 2022] GET /identity/v3/groups/0ea3d11086ca49b984fe1ddefda79675 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:23.731311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fe4ca-94d5-4cf1-abb1-c0d4cb3a0f63 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:23.736198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:23.787052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f479f-523e-4852-8067-7a3f2b8db744 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:23.820368 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36d492-4dc0-462f-8bf9-a1cff5f9596a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:23.820985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36d492-4dc0-462f-8bf9-a1cff5f9596a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:23.821260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36d492-4dc0-462f-8bf9-a1cff5f9596a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:23.821528 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36d492-4dc0-462f-8bf9-a1cff5f9596a None admin] PATH_INFO: `/v3/projects/80330a20cbd94abd8d12b2c485818669` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:23.823193 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36d492-4dc0-462f-8bf9-a1cff5f9596a None admin] RBAC: Authorizing `identity:get_project(project_id=80330a20cbd94abd8d12b2c485818669)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:23.824775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36d492-4dc0-462f-8bf9-a1cff5f9596a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:23.826370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 227/452] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:18:23 2022] GET /identity/v3/projects/80330a20cbd94abd8d12b2c485818669 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:23.826918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:23.831243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fe4ca-94d5-4cf1-abb1-c0d4cb3a0f63 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:23.831827 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36d492-4dc0-462f-8bf9-a1cff5f9596a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:23.865637 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918831a-f9e1-428e-88ef-2ae577c009c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:23.866247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918831a-f9e1-428e-88ef-2ae577c009c7 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:23.866526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918831a-f9e1-428e-88ef-2ae577c009c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:23.866799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918831a-f9e1-428e-88ef-2ae577c009c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:23.867548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918831a-f9e1-428e-88ef-2ae577c009c7 None admin] RBAC: Adding query filter params (group.id=0ea3d11086ca49b984fe1ddefda79675, role.id=655c93c88bc34badbfd2aad45491a96b, scope.project.id=54174d12726547b4bb37d9dd5c21798a) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:23.867855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918831a-f9e1-428e-88ef-2ae577c009c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:23.869287 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918831a-f9e1-428e-88ef-2ae577c009c7 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:23.875072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 226/453] 10.222.0.25 () {56 vars in 1376 bytes} [Sat Sep 24 19:18:23 2022] GET /identity/v3/role_assignments?group.id=0ea3d11086ca49b984fe1ddefda79675&scope.project.id=54174d12726547b4bb37d9dd5c21798a&role.id=655c93c88bc34badbfd2aad45491a96b => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:23.935335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36d492-4dc0-462f-8bf9-a1cff5f9596a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:23.953731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:23.973200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b23acb-15a5-41d1-b04d-feb57341554c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:23.973876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b23acb-15a5-41d1-b04d-feb57341554c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:23.974154 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b23acb-15a5-41d1-b04d-feb57341554c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:23.974428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b23acb-15a5-41d1-b04d-feb57341554c None admin] PATH_INFO: `/v3/groups/709615f3b52442ee95936e1597777228` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:23.975612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b23acb-15a5-41d1-b04d-feb57341554c None admin] RBAC: Authorizing `identity:get_group(group_id=709615f3b52442ee95936e1597777228)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:23.977077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b23acb-15a5-41d1-b04d-feb57341554c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:23.978673 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 228/454] 10.222.0.25 () {56 vars in 1180 bytes} [Sat Sep 24 19:18:23 2022] GET /identity/v3/groups/709615f3b52442ee95936e1597777228 => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:23.984779 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918831a-f9e1-428e-88ef-2ae577c009c7 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:24.088922 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918831a-f9e1-428e-88ef-2ae577c009c7 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:24.124634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f1382-3f45-46ac-968b-547b8a421218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:24.125250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f1382-3f45-46ac-968b-547b8a421218 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:24.125556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f1382-3f45-46ac-968b-547b8a421218 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:24.125832 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f1382-3f45-46ac-968b-547b8a421218 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:24.126558 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f1382-3f45-46ac-968b-547b8a421218 None admin] RBAC: Adding query filter params (group.id=709615f3b52442ee95936e1597777228, role.id=dd27845a836a4f6ebece149dbebc59c0, scope.project.id=80330a20cbd94abd8d12b2c485818669) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:24.126905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f1382-3f45-46ac-968b-547b8a421218 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:24.128335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f1382-3f45-46ac-968b-547b8a421218 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:24.134383 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 227/455] 10.222.0.25 () {56 vars in 1376 bytes} [Sat Sep 24 19:18:23 2022] GET /identity/v3/role_assignments?group.id=709615f3b52442ee95936e1597777228&scope.project.id=80330a20cbd94abd8d12b2c485818669&role.id=dd27845a836a4f6ebece149dbebc59c0 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:26.731661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb6ff4-d37d-4291-a1c1-1859daef4e91 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:26.732163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb6ff4-d37d-4291-a1c1-1859daef4e91 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:26.732240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb6ff4-d37d-4291-a1c1-1859daef4e91 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:26.733795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 229/456] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:26.739269 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245227cd-3e56-4124-88dc-78fc41962a7a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:26.739764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245227cd-3e56-4124-88dc-78fc41962a7a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:26.740234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245227cd-3e56-4124-88dc-78fc41962a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:26.768426 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-245227cd-3e56-4124-88dc-78fc41962a7a None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:26.769625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-245227cd-3e56-4124-88dc-78fc41962a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:26.796060 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:26.869272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 228/457] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:26.999632 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edde7b-ff75-442f-950c-15e26ff18c69 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:26.999922 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edde7b-ff75-442f-950c-15e26ff18c69 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:27.000105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edde7b-ff75-442f-950c-15e26ff18c69 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:27.001688 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 230/458] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:27.007003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8828a4-f462-4347-849d-97af82cdcc24 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:27.007293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8828a4-f462-4347-849d-97af82cdcc24 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:27.007570 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8828a4-f462-4347-849d-97af82cdcc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:27.031386 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-8e8828a4-f462-4347-849d-97af82cdcc24 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:27.032570 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8e8828a4-f462-4347-849d-97af82cdcc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:27.122899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 229/459] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:27.222368 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edde7b-ff75-442f-950c-15e26ff18c69 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:27.368724 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edde7b-ff75-442f-950c-15e26ff18c69 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:27.431552 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53422a77-3bc8-429b-9629-ef2fd4d81eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:27.432277 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53422a77-3bc8-429b-9629-ef2fd4d81eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:27.432558 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53422a77-3bc8-429b-9629-ef2fd4d81eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:27.432825 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53422a77-3bc8-429b-9629-ef2fd4d81eb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:27.446352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53422a77-3bc8-429b-9629-ef2fd4d81eb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:27.447876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53422a77-3bc8-429b-9629-ef2fd4d81eb5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:27.452752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8828a4-f462-4347-849d-97af82cdcc24 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:27.465185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-53422a77-3bc8-429b-9629-ef2fd4d81eb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:27.465185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:27.465185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:27.465185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:27.465185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:27.465185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:27.465185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:27.465185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:27.465185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:27.465185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:27.465185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:27.465185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:27.465185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:27.465185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:27.465185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:27.465185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:27.466140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:27.466140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:27.466140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:27.466140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:27.466140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:27.466140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:27.466140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:27.466140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:27.466140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:27.466140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:27.466140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:27.466140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:27.466140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:27.466140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:27.466140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:27.466140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:27.466140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:27.467048 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:27.467048 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:27.467048 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:27.467048 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 231/460] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:27.473134 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53422a77-3bc8-429b-9629-ef2fd4d81eb5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:27.534139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:27.597225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:27.602995 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53422a77-3bc8-429b-9629-ef2fd4d81eb5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:27.618232 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8828a4-f462-4347-849d-97af82cdcc24 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:27.639842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3f2c5-923d-4795-82bb-d2298fbe023e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:27.640432 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3f2c5-923d-4795-82bb-d2298fbe023e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:27.640706 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3f2c5-923d-4795-82bb-d2298fbe023e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:27.640974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3f2c5-923d-4795-82bb-d2298fbe023e None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:27.641598 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3f2c5-923d-4795-82bb-d2298fbe023e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:27.641892 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3f2c5-923d-4795-82bb-d2298fbe023e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:27.643279 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3f2c5-923d-4795-82bb-d2298fbe023e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:27.655536 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63a164-c5c9-4dd8-8d7c-6be9275eb898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:27.660150 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 232/461] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:27.660273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63a164-c5c9-4dd8-8d7c-6be9275eb898 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:27.660273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63a164-c5c9-4dd8-8d7c-6be9275eb898 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:27.660273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63a164-c5c9-4dd8-8d7c-6be9275eb898 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:27.660484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ed76c-3488-44a8-a3f6-6f3341afe43b None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:27.660484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ed76c-3488-44a8-a3f6-6f3341afe43b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:27.660484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ed76c-3488-44a8-a3f6-6f3341afe43b None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:27.660484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 233/462] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:27.660484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce030bc-b874-4973-9c14-34ee829a72a6 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:27.660768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce030bc-b874-4973-9c14-34ee829a72a6 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:27.660834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce030bc-b874-4973-9c14-34ee829a72a6 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:27.662110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 234/463] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:27.662644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce030bc-b874-4973-9c14-34ee829a72a6 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:27.675920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63a164-c5c9-4dd8-8d7c-6be9275eb898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:27.677046 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63a164-c5c9-4dd8-8d7c-6be9275eb898 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:27.694474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-9d63a164-c5c9-4dd8-8d7c-6be9275eb898 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:27.694474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:27.694474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:27.694474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:27.694474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:27.694474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:27.694474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:27.694474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:27.694474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:27.694474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:27.694474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:27.694474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:27.694474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:27.694474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:27.694474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:27.694474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:27.695462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:27.695462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:27.695462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:27.695462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:27.695462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:27.695462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:27.695462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:27.695462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:27.695462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:27.695462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:27.695462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:27.695462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:27.695462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:27.695462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:27.695462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:27.695462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:27.695462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:27.696289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:27.696289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:27.696289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:27.696289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 230/464] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:27.697558 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad806a6-fe3f-4983-a291-0d8d56cec0d5 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:27.697918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad806a6-fe3f-4983-a291-0d8d56cec0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:27.698253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad806a6-fe3f-4983-a291-0d8d56cec0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:27.716177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-aad806a6-fe3f-4983-a291-0d8d56cec0d5 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:27.717451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-aad806a6-fe3f-4983-a291-0d8d56cec0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:27.774461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:27.782359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce030bc-b874-4973-9c14-34ee829a72a6 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:27.800109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 231/465] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:27.800109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60f033-af25-4799-a4df-9e3bd2781020 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:27.800109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60f033-af25-4799-a4df-9e3bd2781020 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:27.800109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60f033-af25-4799-a4df-9e3bd2781020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:27.820324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-8a60f033-af25-4799-a4df-9e3bd2781020 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:27.821748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8a60f033-af25-4799-a4df-9e3bd2781020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:27.827332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d7240-0480-4746-8263-f73019e4c0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:27.828052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d7240-0480-4746-8263-f73019e4c0c4 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:27.828399 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d7240-0480-4746-8263-f73019e4c0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:27.828718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d7240-0480-4746-8263-f73019e4c0c4 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:27.829358 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d7240-0480-4746-8263-f73019e4c0c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:27.831005 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d7240-0480-4746-8263-f73019e4c0c4 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:27.863114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 235/466] 10.222.0.25 () {60 vars in 1132 bytes} [Sat Sep 24 19:18:27 2022] POST /identity/v3/users => generated 246 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:18:27.864149 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d7240-0480-4746-8263-f73019e4c0c4 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:27.931078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:27.940787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 232/467] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:28.048839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d7240-0480-4746-8263-f73019e4c0c4 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:28.094590 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccaf607-0247-4af0-ac86-4f2f9281aa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:28.095328 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccaf607-0247-4af0-ac86-4f2f9281aa71 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:28.095606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccaf607-0247-4af0-ac86-4f2f9281aa71 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:28.095876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccaf607-0247-4af0-ac86-4f2f9281aa71 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:28.096517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccaf607-0247-4af0-ac86-4f2f9281aa71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:28.096815 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccaf607-0247-4af0-ac86-4f2f9281aa71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:28.098494 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccaf607-0247-4af0-ac86-4f2f9281aa71 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:28.112500 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 236/468] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:28.117903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60f033-af25-4799-a4df-9e3bd2781020 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:28.206099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccaf607-0247-4af0-ac86-4f2f9281aa71 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:28.231694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:28.262482 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60f033-af25-4799-a4df-9e3bd2781020 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:28.307772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4e55d-f077-4480-b897-acb6dc8b47eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:28.308386 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4e55d-f077-4480-b897-acb6dc8b47eb None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:28.308666 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4e55d-f077-4480-b897-acb6dc8b47eb None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:28.308933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4e55d-f077-4480-b897-acb6dc8b47eb None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:28.309606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4e55d-f077-4480-b897-acb6dc8b47eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:28.311068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4e55d-f077-4480-b897-acb6dc8b47eb None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:28.332580 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 233/469] 10.222.0.25 () {60 vars in 1132 bytes} [Sat Sep 24 19:18:28 2022] POST /identity/v3/users => generated 248 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:18:28.333218 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4e55d-f077-4480-b897-acb6dc8b47eb None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:28.356806 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccaf607-0247-4af0-ac86-4f2f9281aa71 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:28.403385 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9d65b-7d18-4c05-a5c1-aeaae9db978a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:28.404679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9d65b-7d18-4c05-a5c1-aeaae9db978a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:28.405137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9d65b-7d18-4c05-a5c1-aeaae9db978a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:28.405599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9d65b-7d18-4c05-a5c1-aeaae9db978a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:28.406071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:28.424246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9d65b-7d18-4c05-a5c1-aeaae9db978a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:28.426099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9d65b-7d18-4c05-a5c1-aeaae9db978a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:28.444741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-eae9d65b-7d18-4c05-a5c1-aeaae9db978a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:28.444741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:28.444741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:28.444741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:28.444741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:28.444741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:28.444741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:28.444741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:28.444741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:28.444741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:28.444741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:28.444741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:28.444741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:28.444741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:28.444741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:28.444741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:28.445809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:28.445809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:28.445809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:28.445809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:28.445809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:28.445809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:28.445809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:28.445809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:28.445809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:28.445809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:28.445809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:28.445809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:28.445809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:28.445809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:28.445809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:28.445809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:28.445809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:28.446671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:28.446671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:28.446671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:28.446671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 237/470] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:28.448128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a116823-4ad6-4730-9f75-32d0014caab0 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:28.448606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a116823-4ad6-4730-9f75-32d0014caab0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:28.449446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a116823-4ad6-4730-9f75-32d0014caab0 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:28.455387 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 238/471] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:28.456371 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a116823-4ad6-4730-9f75-32d0014caab0 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:28.471384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4e55d-f077-4480-b897-acb6dc8b47eb None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:28.519928 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ee0b7-2b27-45a0-9296-39931dfdc92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:28.521239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ee0b7-2b27-45a0-9296-39931dfdc92f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:28.522108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ee0b7-2b27-45a0-9296-39931dfdc92f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:28.522663 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ee0b7-2b27-45a0-9296-39931dfdc92f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:28.536759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:28.542448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ee0b7-2b27-45a0-9296-39931dfdc92f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:28.544900 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ee0b7-2b27-45a0-9296-39931dfdc92f None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:28.561160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-150ee0b7-2b27-45a0-9296-39931dfdc92f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:28.561160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:28.561160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:28.561160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:28.561160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:28.561160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:28.561160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:28.561160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:28.561160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:28.561160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:28.561160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:28.561160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:28.561160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:28.561160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:28.561160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:28.561160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:28.562135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:28.562135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:28.562135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:28.562135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:28.562135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:28.562135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:28.562135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:28.562135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:28.562135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:28.562135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:28.562135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:28.562135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:28.562135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:28.562135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:28.562135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:28.562135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:28.562135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:28.563866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:28.563866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:28.563866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:28.563866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 234/472] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:28.563866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a167d33-3b21-4430-88b7-fef12e485a39 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:28.563866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a167d33-3b21-4430-88b7-fef12e485a39 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:28.564198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a167d33-3b21-4430-88b7-fef12e485a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:28.586426 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-8a167d33-3b21-4430-88b7-fef12e485a39 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:28.587690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8a167d33-3b21-4430-88b7-fef12e485a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:28.599546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a116823-4ad6-4730-9f75-32d0014caab0 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:28.642368 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27235c8d-7583-4afc-b688-68dbde95459e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:28.643010 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27235c8d-7583-4afc-b688-68dbde95459e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:28.643288 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27235c8d-7583-4afc-b688-68dbde95459e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:28.643584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27235c8d-7583-4afc-b688-68dbde95459e None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:28.644198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27235c8d-7583-4afc-b688-68dbde95459e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:28.644497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27235c8d-7583-4afc-b688-68dbde95459e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:28.645878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27235c8d-7583-4afc-b688-68dbde95459e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:28.658474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 239/473] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:28.659223 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27235c8d-7583-4afc-b688-68dbde95459e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:28.678872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 235/474] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:28.678872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a167d33-3b21-4430-88b7-fef12e485a39 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:28.747309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:28.849575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27235c8d-7583-4afc-b688-68dbde95459e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:28.852903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a167d33-3b21-4430-88b7-fef12e485a39 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:28.893849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:28.912276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce30cab-fb2a-49ce-b39a-5ddd7e8b1188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:28.912881 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce30cab-fb2a-49ce-b39a-5ddd7e8b1188 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:28.913160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce30cab-fb2a-49ce-b39a-5ddd7e8b1188 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:28.913427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce30cab-fb2a-49ce-b39a-5ddd7e8b1188 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:28.914056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce30cab-fb2a-49ce-b39a-5ddd7e8b1188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:28.914360 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce30cab-fb2a-49ce-b39a-5ddd7e8b1188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:28.915752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce30cab-fb2a-49ce-b39a-5ddd7e8b1188 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:28.924432 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d383a7c-45f2-4c1d-bf9c-1cfa4149b55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:28.925357 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d383a7c-45f2-4c1d-bf9c-1cfa4149b55a None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:28.925648 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d383a7c-45f2-4c1d-bf9c-1cfa4149b55a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:28.925919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d383a7c-45f2-4c1d-bf9c-1cfa4149b55a None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:28.926570 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d383a7c-45f2-4c1d-bf9c-1cfa4149b55a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:28.931548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d383a7c-45f2-4c1d-bf9c-1cfa4149b55a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:28.949641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 240/475] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:28.955200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce30cab-fb2a-49ce-b39a-5ddd7e8b1188 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:28.955353 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 236/476] 10.222.0.25 () {60 vars in 1132 bytes} [Sat Sep 24 19:18:28 2022] POST /identity/v3/users => generated 249 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:18:29.071896 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d383a7c-45f2-4c1d-bf9c-1cfa4149b55a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:29.078860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce30cab-fb2a-49ce-b39a-5ddd7e8b1188 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:29.118425 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46eb85-8964-4f86-9115-8568be81b182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:29.119080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46eb85-8964-4f86-9115-8568be81b182 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:29.119422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46eb85-8964-4f86-9115-8568be81b182 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:29.120215 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46eb85-8964-4f86-9115-8568be81b182 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:29.120939 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46eb85-8964-4f86-9115-8568be81b182 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:29.122704 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46eb85-8964-4f86-9115-8568be81b182 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:29.163854 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 241/477] 10.222.0.25 () {60 vars in 1132 bytes} [Sat Sep 24 19:18:28 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:18:29.246130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d383a7c-45f2-4c1d-bf9c-1cfa4149b55a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:29.248839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:29.290238 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57e935-23f1-4c79-87a3-57064117cb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:29.290897 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57e935-23f1-4c79-87a3-57064117cb0f None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:29.291743 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57e935-23f1-4c79-87a3-57064117cb0f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:29.292181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57e935-23f1-4c79-87a3-57064117cb0f None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:29.292961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57e935-23f1-4c79-87a3-57064117cb0f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:29.294402 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57e935-23f1-4c79-87a3-57064117cb0f None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:29.303716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.sql.core [None req-dd57e935-23f1-4c79-87a3-57064117cb0f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 24 19:18:29.303716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 24 19:18:29.303716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [parameters: {'id': '7a29d9a9d8064cd8ac9eec015ce5fe19', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 24 19:18:29.303716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81421) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 24 19:18:29.321363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-dd57e935-23f1-4c79-87a3-57064117cb0f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 24 19:18:29.321363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:29.321363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 19:18:29.321363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 19:18:29.321363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 19:18:29.321363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 19:18:29.321363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 19:18:29.321363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 19:18:29.321363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 19:18:29.321363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application conn.query(q) Sep 24 19:18:29.321363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 19:18:29.321363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 19:18:29.321363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 19:18:29.321363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application result.read() Sep 24 19:18:29.321363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 19:18:29.322943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 19:18:29.322943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 19:18:29.322943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 19:18:29.322943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 19:18:29.322943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 19:18:29.322943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 19:18:29.322943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 19:18:29.322943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 24 19:18:29.322943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:29.322943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 24 19:18:29.322943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:29.322943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:29.322943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 24 19:18:29.322943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 24 19:18:29.322943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 24 19:18:29.322943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return ref.to_dict() Sep 24 19:18:29.322943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 19:18:29.322943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application next(self.gen) Sep 24 19:18:29.323911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 24 19:18:29.323911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application yield resource Sep 24 19:18:29.323911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 19:18:29.323911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application next(self.gen) Sep 24 19:18:29.323911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 24 19:18:29.323911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self.session.rollback() Sep 24 19:18:29.323911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 19:18:29.323911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self.force_reraise() Sep 24 19:18:29.323911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 19:18:29.323911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise self.value Sep 24 19:18:29.323911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 24 19:18:29.323911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 24 19:18:29.323911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 24 19:18:29.323911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application session.commit() Sep 24 19:18:29.323911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 24 19:18:29.323911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 24 19:18:29.323911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 24 19:18:29.325616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._prepare_impl() Sep 24 19:18:29.325616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 24 19:18:29.325616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self.session.flush() Sep 24 19:18:29.325616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 24 19:18:29.325616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._flush(objects) Sep 24 19:18:29.325616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 24 19:18:29.325616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 24 19:18:29.325616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 24 19:18:29.325616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application compat.raise_( Sep 24 19:18:29.325616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 19:18:29.325616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception Sep 24 19:18:29.325616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 24 19:18:29.325616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application flush_context.execute() Sep 24 19:18:29.325616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 24 19:18:29.325616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rec.execute(self) Sep 24 19:18:29.325616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 24 19:18:29.325616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 24 19:18:29.326722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 24 19:18:29.326722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 24 19:18:29.326722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 24 19:18:29.326722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 24 19:18:29.326722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 24 19:18:29.326722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 24 19:18:29.326722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 24 19:18:29.326722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 24 19:18:29.326722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 24 19:18:29.326722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 24 19:18:29.326722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 24 19:18:29.326722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 24 19:18:29.326722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 24 19:18:29.326722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 24 19:18:29.326722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 19:18:29.326722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception Sep 24 19:18:29.327961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 19:18:29.327961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 19:18:29.327961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 19:18:29.327961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 19:18:29.327961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 19:18:29.327961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 19:18:29.327961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 19:18:29.327961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application conn.query(q) Sep 24 19:18:29.327961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 19:18:29.327961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 19:18:29.327961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 19:18:29.327961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application result.read() Sep 24 19:18:29.327961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 19:18:29.327961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 19:18:29.327961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 19:18:29.327961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 19:18:29.332702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 19:18:29.332702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 19:18:29.332702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 19:18:29.332702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 19:18:29.332702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 24 19:18:29.332702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 24 19:18:29.332702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [parameters: {'id': '7a29d9a9d8064cd8ac9eec015ce5fe19', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 24 19:18:29.332702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 24 19:18:29.332702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:29.332702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:18:29.332702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:29.332702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:29.332702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:29.332702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:29.332702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:29.332702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:29.333541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:29.333541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:29.333541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:29.333541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:29.333541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:29.333541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:29.333541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 24 19:18:29.333541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 24 19:18:29.333541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:29.333541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:29.333541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 24 19:18:29.333541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 24 19:18:29.333541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 24 19:18:29.333541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 24 19:18:29.333541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 24 19:18:29.333541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:29.334363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 237/478] 10.222.0.25 () {60 vars in 1131 bytes} [Sat Sep 24 19:18:29 2022] POST /identity/v3/roles => generated 144 bytes in 253 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:18:29.334428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46eb85-8964-4f86-9115-8568be81b182 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:29.383964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:29.457315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46eb85-8964-4f86-9115-8568be81b182 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:29.496691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d1ecb-b691-4e89-90e0-8604a32b8eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:29.497338 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d1ecb-b691-4e89-90e0-8604a32b8eca None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:29.497615 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d1ecb-b691-4e89-90e0-8604a32b8eca None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:29.497884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d1ecb-b691-4e89-90e0-8604a32b8eca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:29.508973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d1ecb-b691-4e89-90e0-8604a32b8eca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:29.515011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-601d1ecb-b691-4e89-90e0-8604a32b8eca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:18:29.515011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:29.515011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:29.515011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:29.515011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:29.515011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:29.515011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:29.515011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:29.515011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:29.515011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:29.515011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:29.515011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:29.515011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:29.515011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:29.515011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:29.515011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:29.515899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:29.515899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:29.515899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:29.515899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:29.515899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:29.515899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:29.515899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:29.515899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:29.515899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:29.515899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:29.515899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:29.515899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:29.515899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:29.515899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:29.515899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:29.515899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:29.516705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:29.516705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:29.516705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:29.516705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:29.516705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:29.516705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:29.516705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:29.516705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:29.516705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:29.516705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:29.516705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:18:29.516705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:29.516705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 242/479] 10.222.0.25 () {56 vars in 1114 bytes} [Sat Sep 24 19:18:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:29.522184 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57e935-23f1-4c79-87a3-57064117cb0f None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:29.636482 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57e935-23f1-4c79-87a3-57064117cb0f None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:29.671343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620f001-fe93-45c8-b134-9f211196b230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:29.672286 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620f001-fe93-45c8-b134-9f211196b230 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:29.672754 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620f001-fe93-45c8-b134-9f211196b230 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:29.673278 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620f001-fe93-45c8-b134-9f211196b230 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:29.674151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620f001-fe93-45c8-b134-9f211196b230 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:29.674672 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620f001-fe93-45c8-b134-9f211196b230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:29.677850 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620f001-fe93-45c8-b134-9f211196b230 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:29.690038 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 238/480] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:30.488883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1e7c0-4cb5-4916-a7ae-6d8b0f1e0900 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:30.489441 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1e7c0-4cb5-4916-a7ae-6d8b0f1e0900 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:30.489441 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1e7c0-4cb5-4916-a7ae-6d8b0f1e0900 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:30.491046 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 243/481] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:30.503050 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4021fb1-a4d6-4f25-8348-49db3ff3d70d None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:30.503524 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4021fb1-a4d6-4f25-8348-49db3ff3d70d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:30.503610 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4021fb1-a4d6-4f25-8348-49db3ff3d70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:30.528846 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-e4021fb1-a4d6-4f25-8348-49db3ff3d70d None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:30.530050 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e4021fb1-a4d6-4f25-8348-49db3ff3d70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:30.551169 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:30.628465 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 239/482] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:30.873671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd1edc-3d0e-41b2-b9d4-e81c52c72baa None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:30.874102 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd1edc-3d0e-41b2-b9d4-e81c52c72baa None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:30.874212 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd1edc-3d0e-41b2-b9d4-e81c52c72baa None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:30.875822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 244/483] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:30.880830 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bf7c8-764f-489e-adc0-edcfe83a0b6a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:30.881187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bf7c8-764f-489e-adc0-edcfe83a0b6a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:30.881469 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bf7c8-764f-489e-adc0-edcfe83a0b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:30.907813 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-657bf7c8-764f-489e-adc0-edcfe83a0b6a None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:30.909015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-657bf7c8-764f-489e-adc0-edcfe83a0b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:30.989403 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 240/484] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:31.028037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd1edc-3d0e-41b2-b9d4-e81c52c72baa None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:31.143989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:31.147782 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd1edc-3d0e-41b2-b9d4-e81c52c72baa None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:31.184334 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e3c22-9995-424a-ac55-01dbe00a68fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:31.184973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e3c22-9995-424a-ac55-01dbe00a68fa None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:31.185251 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e3c22-9995-424a-ac55-01dbe00a68fa None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:31.185526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e3c22-9995-424a-ac55-01dbe00a68fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:31.197432 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e3c22-9995-424a-ac55-01dbe00a68fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:31.202805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-320e3c22-9995-424a-ac55-01dbe00a68fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:31.202805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:31.202805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:31.202805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:31.202805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:31.202805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:31.202805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:31.202805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:31.202805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:31.202805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:31.202805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:31.202805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:31.202805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:31.202805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:31.202805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:31.202805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:31.203726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:31.203726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:31.203726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:31.203726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:31.203726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:31.203726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:31.203726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:31.203726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:31.203726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:31.203726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:31.203726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:31.203726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:31.203726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:31.203726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:31.203726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:31.203726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:31.204507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:31.204507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:31.204507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:31.204507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:31.204507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:31.204507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:31.204507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:31.204507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:31.204507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:31.204507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:31.204507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:31.204507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:31.204507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 245/485] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:18:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:18:31.212285 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657bf7c8-764f-489e-adc0-edcfe83a0b6a None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:31.324541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:31.353441 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657bf7c8-764f-489e-adc0-edcfe83a0b6a None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:31.397424 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71349c58-dbbb-42ed-998a-3ebef0a4589d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:31.397952 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71349c58-dbbb-42ed-998a-3ebef0a4589d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:31.398227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71349c58-dbbb-42ed-998a-3ebef0a4589d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:31.398495 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71349c58-dbbb-42ed-998a-3ebef0a4589d None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:31.399436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71349c58-dbbb-42ed-998a-3ebef0a4589d None admin] RBAC: Adding query filter params (name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:31.399737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71349c58-dbbb-42ed-998a-3ebef0a4589d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:31.402093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71349c58-dbbb-42ed-998a-3ebef0a4589d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:31.424913 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 241/486] 10.222.0.25 () {56 vars in 1103 bytes} [Sat Sep 24 19:18:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:31.430474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e3c22-9995-424a-ac55-01dbe00a68fa None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:31.438686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71349c58-dbbb-42ed-998a-3ebef0a4589d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:31.544898 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71349c58-dbbb-42ed-998a-3ebef0a4589d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:31.579986 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf5fd9-ad41-4e5e-97a1-5d1324651797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:31.580614 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf5fd9-ad41-4e5e-97a1-5d1324651797 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:31.580885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf5fd9-ad41-4e5e-97a1-5d1324651797 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:31.581150 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf5fd9-ad41-4e5e-97a1-5d1324651797 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:31.591892 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf5fd9-ad41-4e5e-97a1-5d1324651797 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:31.597103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-9caf5fd9-ad41-4e5e-97a1-5d1324651797 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:31.597103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:31.597103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:31.597103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:31.597103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:31.597103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:31.597103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:31.597103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:31.597103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:31.597103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:31.597103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:31.597103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:31.597103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:31.597103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:31.597103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:31.597103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:31.597983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:31.597983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:31.597983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:31.597983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:31.597983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:31.597983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:31.597983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:31.597983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:31.597983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:31.597983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:31.597983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:31.597983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:31.597983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:31.597983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:31.597983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:31.597983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:31.598775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:31.598775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:31.598775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:31.598775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:31.598775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:31.598775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:31.598775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:31.598775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:31.598775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:31.598775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:31.598775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:31.598775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:31.598775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 242/487] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:18:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:18:31.599826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:31.605816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf5fd9-ad41-4e5e-97a1-5d1324651797 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:31.645352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e3c22-9995-424a-ac55-01dbe00a68fa None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:31.711542 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf5fd9-ad41-4e5e-97a1-5d1324651797 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:31.711715 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb5b0f-3602-4972-b81c-b5f6be33ad3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:31.712177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb5b0f-3602-4972-b81c-b5f6be33ad3f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:31.712455 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb5b0f-3602-4972-b81c-b5f6be33ad3f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:31.712728 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb5b0f-3602-4972-b81c-b5f6be33ad3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:31.735329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb5b0f-3602-4972-b81c-b5f6be33ad3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:31.736793 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb5b0f-3602-4972-b81c-b5f6be33ad3f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:31.765210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-0cbb5b0f-3602-4972-b81c-b5f6be33ad3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:31.765210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:31.765210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:31.765210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:31.765210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:31.765210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:31.765210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:31.765210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:31.765210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:31.765210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:31.765210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:31.765210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:31.765210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:31.765210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:31.765210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:31.765210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:31.766185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:31.766185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:31.766185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:31.766185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:31.766185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:31.766185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:31.766185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:31.766185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:31.766185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:31.766185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:31.766185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:31.766185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:31.766185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:31.766185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:31.766185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:31.766185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:31.766185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:31.767037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:31.767037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:31.767037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:31.767037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 246/488] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:31.769079 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1fb34-597a-4eed-b48c-e1d49167c1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:31.769688 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1fb34-597a-4eed-b48c-e1d49167c1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:31.769960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1fb34-597a-4eed-b48c-e1d49167c1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:31.770227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1fb34-597a-4eed-b48c-e1d49167c1a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:31.770914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1fb34-597a-4eed-b48c-e1d49167c1a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:31.771462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1fb34-597a-4eed-b48c-e1d49167c1a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:31.772832 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1fb34-597a-4eed-b48c-e1d49167c1a7 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:31.776138 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb5b0f-3602-4972-b81c-b5f6be33ad3f None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:31.787637 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 243/489] 10.222.0.25 () {56 vars in 1103 bytes} [Sat Sep 24 19:18:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:31.798182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1fb34-597a-4eed-b48c-e1d49167c1a7 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:31.803193 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:31.955325 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:31.985508 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb5b0f-3602-4972-b81c-b5f6be33ad3f None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:32.039980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aba61d-76d5-40cb-a9c9-ec2e81fd8033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:32.040588 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aba61d-76d5-40cb-a9c9-ec2e81fd8033 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:32.040863 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aba61d-76d5-40cb-a9c9-ec2e81fd8033 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:32.041897 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aba61d-76d5-40cb-a9c9-ec2e81fd8033 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:32.042544 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aba61d-76d5-40cb-a9c9-ec2e81fd8033 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:32.043724 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aba61d-76d5-40cb-a9c9-ec2e81fd8033 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:32.045107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aba61d-76d5-40cb-a9c9-ec2e81fd8033 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:32.049207 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1fb34-597a-4eed-b48c-e1d49167c1a7 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:32.080857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 247/490] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:32.082218 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c724473-d71b-44c3-866d-8fca337e1592 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:32.082504 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c724473-d71b-44c3-866d-8fca337e1592 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:32.082779 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c724473-d71b-44c3-866d-8fca337e1592 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:32.088768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 248/491] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:32.089897 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c724473-d71b-44c3-866d-8fca337e1592 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:32.117757 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bd3ae-0a0b-4ddb-be2a-3abc381d5ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:32.118412 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bd3ae-0a0b-4ddb-be2a-3abc381d5ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:32.118713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bd3ae-0a0b-4ddb-be2a-3abc381d5ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:32.119018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bd3ae-0a0b-4ddb-be2a-3abc381d5ab9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:32.132095 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0bd3ae-0a0b-4ddb-be2a-3abc381d5ab9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:32.133570 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0bd3ae-0a0b-4ddb-be2a-3abc381d5ab9 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:32.151194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-ed0bd3ae-0a0b-4ddb-be2a-3abc381d5ab9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:32.151194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:32.151194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:32.151194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:32.151194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:32.151194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:32.151194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:32.151194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:32.151194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:32.151194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:32.151194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:32.151194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:32.151194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:32.151194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:32.151194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:32.151194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:32.152398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:32.152398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:32.152398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:32.152398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:32.152398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:32.152398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:32.152398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:32.152398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:32.152398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:32.152398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:32.152398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:32.152398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:32.152398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:32.152398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:32.152398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:32.152398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:32.152398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:32.153490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:32.153490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:32.153490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:32.157196 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 244/492] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:32.158656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce4063-c141-4c9a-945a-14bf798fad47 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:32.158991 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce4063-c141-4c9a-945a-14bf798fad47 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:32.159271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce4063-c141-4c9a-945a-14bf798fad47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:32.204748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-0dce4063-c141-4c9a-945a-14bf798fad47 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:32.205962 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-0dce4063-c141-4c9a-945a-14bf798fad47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:32.238023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:32.274662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c724473-d71b-44c3-866d-8fca337e1592 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:32.311615 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 245/493] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:32.312818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce4063-c141-4c9a-945a-14bf798fad47 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:32.325192 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cefcaf-ed5e-468e-ab66-f3c68150296f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:32.326321 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cefcaf-ed5e-468e-ab66-f3c68150296f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:32.326668 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cefcaf-ed5e-468e-ab66-f3c68150296f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:32.327053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cefcaf-ed5e-468e-ab66-f3c68150296f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:32.335915 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cefcaf-ed5e-468e-ab66-f3c68150296f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:32.337424 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cefcaf-ed5e-468e-ab66-f3c68150296f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:32.357055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-10cefcaf-ed5e-468e-ab66-f3c68150296f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:18:32.357055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:32.357055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:32.357055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:32.357055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:32.357055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:32.357055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:32.357055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:32.357055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:32.357055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:32.357055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:32.357055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:32.357055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:18:32.357055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:18:32.357055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:18:32.357055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:18:32.358016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:32.358016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:32.358016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:18:32.358016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:32.358016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:18:32.358016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:32.358016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:32.358016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:32.358016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:32.358016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:32.358016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:32.358016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:32.358016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:32.358016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:32.358016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:32.358016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:32.358016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:32.358016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:32.359293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:32.359293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:32.359293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:18:32.359293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:18:32.359293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:18:32.359293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:18:32.359293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:18:32.359293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:18:32.359293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:18:32.359293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:32.359293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 249/494] 10.222.0.25 () {56 vars in 1093 bytes} [Sat Sep 24 19:18:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:32.360613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e5c7a-756f-477e-ad5e-6db05a1a8799 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:32.360961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e5c7a-756f-477e-ad5e-6db05a1a8799 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:32.361298 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e5c7a-756f-477e-ad5e-6db05a1a8799 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:32.367257 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 250/495] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:32.367257 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e5c7a-756f-477e-ad5e-6db05a1a8799 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:32.375064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:32.456343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce4063-c141-4c9a-945a-14bf798fad47 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:32.500883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1853312-bcc9-4965-b3f9-f5fb477c1cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:32.501444 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1853312-bcc9-4965-b3f9-f5fb477c1cad None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:32.501725 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1853312-bcc9-4965-b3f9-f5fb477c1cad None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:32.501997 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1853312-bcc9-4965-b3f9-f5fb477c1cad None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:32.502722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1853312-bcc9-4965-b3f9-f5fb477c1cad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:32.503041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1853312-bcc9-4965-b3f9-f5fb477c1cad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:32.504479 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1853312-bcc9-4965-b3f9-f5fb477c1cad None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:32.504881 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e5c7a-756f-477e-ad5e-6db05a1a8799 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:32.519753 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 246/496] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:32.521102 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35293906-26e2-4ca3-9c96-5eb7b1be5adc None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:32.521394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35293906-26e2-4ca3-9c96-5eb7b1be5adc None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:32.521671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35293906-26e2-4ca3-9c96-5eb7b1be5adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:32.542209 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:32.545994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-35293906-26e2-4ca3-9c96-5eb7b1be5adc None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:32.547413 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-35293906-26e2-4ca3-9c96-5eb7b1be5adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:32.553503 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf24b2-e7ed-4bbc-9cb2-ec6b037831b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:32.554159 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf24b2-e7ed-4bbc-9cb2-ec6b037831b2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:32.554442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf24b2-e7ed-4bbc-9cb2-ec6b037831b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:32.554711 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf24b2-e7ed-4bbc-9cb2-ec6b037831b2 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:32.555470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf24b2-e7ed-4bbc-9cb2-ec6b037831b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:32.557518 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf24b2-e7ed-4bbc-9cb2-ec6b037831b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:32.559637 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf24b2-e7ed-4bbc-9cb2-ec6b037831b2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:32.613513 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 251/497] 10.222.0.25 () {56 vars in 1133 bytes} [Sat Sep 24 19:18:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:32.613513 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf24b2-e7ed-4bbc-9cb2-ec6b037831b2 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:32.638857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 247/498] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:32.638857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35293906-26e2-4ca3-9c96-5eb7b1be5adc None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:32.686655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:32.717736 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf24b2-e7ed-4bbc-9cb2-ec6b037831b2 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:32.755052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76218253-ad5e-4a45-99aa-355ba6ee9f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:32.755722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76218253-ad5e-4a45-99aa-355ba6ee9f30 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:32.756003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76218253-ad5e-4a45-99aa-355ba6ee9f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:32.756273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76218253-ad5e-4a45-99aa-355ba6ee9f30 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:32.764871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76218253-ad5e-4a45-99aa-355ba6ee9f30 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:32.766552 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76218253-ad5e-4a45-99aa-355ba6ee9f30 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:32.770283 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35293906-26e2-4ca3-9c96-5eb7b1be5adc None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:32.779457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-76218253-ad5e-4a45-99aa-355ba6ee9f30 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 24 19:18:32.779457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:32.779457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:32.779457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:32.779457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:32.779457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:32.779457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:32.779457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:32.779457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:32.779457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:32.779457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:32.779457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:32.779457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:18:32.779457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:18:32.779457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:18:32.779457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:18:32.780376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:32.780376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:32.780376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:18:32.780376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:32.780376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:18:32.780376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:32.780376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:32.780376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:32.780376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:32.780376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:32.780376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:32.780376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:32.780376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:32.780376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:32.780376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:32.780376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:32.780376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:32.780376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:32.781280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:32.781280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:32.781280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:18:32.781280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:18:32.781280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:18:32.781280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:18:32.781280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:18:32.781280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:18:32.781280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 24 19:18:32.781280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:32.781280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 252/499] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:32.781847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76218253-ad5e-4a45-99aa-355ba6ee9f30 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:32.813698 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639aec9b-40e5-407b-8997-d88ac69790d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:32.814440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aec9b-40e5-407b-8997-d88ac69790d5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:32.814715 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aec9b-40e5-407b-8997-d88ac69790d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:32.815115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aec9b-40e5-407b-8997-d88ac69790d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:32.826112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639aec9b-40e5-407b-8997-d88ac69790d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:32.831446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-639aec9b-40e5-407b-8997-d88ac69790d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:32.831446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:32.831446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:32.831446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:32.831446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:32.831446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:32.831446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:32.831446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:32.831446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:32.831446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:32.831446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:32.831446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:32.831446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:32.831446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:32.831446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:32.831446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:32.832515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:32.832515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:32.832515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:32.832515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:32.832515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:32.832515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:32.832515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:32.832515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:32.832515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:32.832515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:32.832515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:32.832515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:32.832515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:32.832515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:32.832515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:32.832515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:32.833532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:32.833532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:32.833532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:32.833532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:32.833532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:32.833532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:32.833532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:32.833532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:32.833532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:32.833532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:32.833532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:32.833532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:32.833532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 248/500] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:18:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:32.834349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df9518-7264-44a0-9576-6e4e8bee20df None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:32.834349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df9518-7264-44a0-9576-6e4e8bee20df None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:32.834349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df9518-7264-44a0-9576-6e4e8bee20df None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:32.835501 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 249/501] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:32.839253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df9518-7264-44a0-9576-6e4e8bee20df None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:32.841799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:32.896667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76218253-ad5e-4a45-99aa-355ba6ee9f30 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:32.938178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e7323-a861-4598-bdbf-fe099fd1157b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:32.938490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:32.939426 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e7323-a861-4598-bdbf-fe099fd1157b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:32.939780 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e7323-a861-4598-bdbf-fe099fd1157b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:32.940564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e7323-a861-4598-bdbf-fe099fd1157b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:32.949805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df9518-7264-44a0-9576-6e4e8bee20df None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:32.986313 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4932a-96ea-4a7f-959e-683db3f8bb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:32.986946 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4932a-96ea-4a7f-959e-683db3f8bb61 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:32.987220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4932a-96ea-4a7f-959e-683db3f8bb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:32.987485 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4932a-96ea-4a7f-959e-683db3f8bb61 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:32.988196 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4932a-96ea-4a7f-959e-683db3f8bb61 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:32.988495 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4932a-96ea-4a7f-959e-683db3f8bb61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:32.989904 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4932a-96ea-4a7f-959e-683db3f8bb61 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:33.016218 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e7323-a861-4598-bdbf-fe099fd1157b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:33.017593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e7323-a861-4598-bdbf-fe099fd1157b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:33.027308 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 250/502] 10.222.0.25 () {56 vars in 1137 bytes} [Sat Sep 24 19:18:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:33.028612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42aab14-5ebf-4669-8af9-a3ad31074795 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:33.028905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42aab14-5ebf-4669-8af9-a3ad31074795 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:33.029185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42aab14-5ebf-4669-8af9-a3ad31074795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:33.047104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-d42aab14-5ebf-4669-8af9-a3ad31074795 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:33.048306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d42aab14-5ebf-4669-8af9-a3ad31074795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:33.066663 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:33.118324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 251/503] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:33.119753 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42aab14-5ebf-4669-8af9-a3ad31074795 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:33.123542 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 253/504] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:18:33.124427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e7323-a861-4598-bdbf-fe099fd1157b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:33.207900 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:33.226678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e7323-a861-4598-bdbf-fe099fd1157b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:33.228162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42aab14-5ebf-4669-8af9-a3ad31074795 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:33.263840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5508c-406c-43b7-84f4-143eb98536bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:33.264304 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b91ff5-5233-467e-9f2d-475c29498045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:33.264445 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5508c-406c-43b7-84f4-143eb98536bd None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:33.264731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5508c-406c-43b7-84f4-143eb98536bd None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:33.264915 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b91ff5-5233-467e-9f2d-475c29498045 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:33.265011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5508c-406c-43b7-84f4-143eb98536bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:33.265193 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b91ff5-5233-467e-9f2d-475c29498045 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:33.265528 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b91ff5-5233-467e-9f2d-475c29498045 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:33.266122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b91ff5-5233-467e-9f2d-475c29498045 None admin] RBAC: Adding query filter params (name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:33.266475 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b91ff5-5233-467e-9f2d-475c29498045 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:33.267840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b91ff5-5233-467e-9f2d-475c29498045 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:33.276637 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 252/505] 10.222.0.25 () {56 vars in 1103 bytes} [Sat Sep 24 19:18:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:33.277422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b91ff5-5233-467e-9f2d-475c29498045 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:33.282288 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5508c-406c-43b7-84f4-143eb98536bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:33.287339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-2ba5508c-406c-43b7-84f4-143eb98536bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:33.287339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:33.287339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:33.287339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:33.287339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:33.287339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:33.287339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:33.287339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:33.287339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:33.287339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:33.287339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:33.287339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:33.287339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:33.287339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:33.287339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:33.287339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:33.288261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:33.288261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:33.288261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:33.288261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:33.288261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:33.288261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:33.288261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:33.288261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:33.288261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:33.288261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:33.288261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:33.288261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:33.288261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:33.288261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:33.288261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:33.288261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:33.289879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:33.289879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:33.289879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:33.289879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:33.289879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:33.289879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:33.289879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:33.289879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:33.289879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:33.289879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:33.289879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:33.289879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:33.289879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 254/506] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:18:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:33.289879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5508c-406c-43b7-84f4-143eb98536bd None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:33.304646 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:33.391077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b91ff5-5233-467e-9f2d-475c29498045 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:33.402351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5508c-406c-43b7-84f4-143eb98536bd None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:33.429228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c8580-4791-4227-8cc4-834bbe3b6790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:33.429830 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c8580-4791-4227-8cc4-834bbe3b6790 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:33.430102 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c8580-4791-4227-8cc4-834bbe3b6790 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:33.430372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c8580-4791-4227-8cc4-834bbe3b6790 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:33.437692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c5d65-64b6-4fac-b70c-6497408a2f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:33.438310 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c5d65-64b6-4fac-b70c-6497408a2f6f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:33.438590 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c5d65-64b6-4fac-b70c-6497408a2f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:33.438882 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c5d65-64b6-4fac-b70c-6497408a2f6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:33.444552 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:33.449445 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c5d65-64b6-4fac-b70c-6497408a2f6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:33.450923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c5d65-64b6-4fac-b70c-6497408a2f6f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:33.466084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-473c5d65-64b6-4fac-b70c-6497408a2f6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:33.466084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:33.466084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:33.466084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:33.466084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:33.466084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:33.466084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:33.466084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:33.466084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:33.466084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:33.466084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:33.466084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:33.466084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:33.466084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:33.466084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:33.466084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:33.467026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:33.467026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:33.467026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:33.467026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:33.467026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:33.467026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:33.467026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:33.467026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:33.467026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:33.467026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:33.467026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:33.467026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:33.467026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:33.467026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:33.467026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:33.467026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:33.467026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:33.467913 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:33.467913 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:33.467913 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:33.467913 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 255/507] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:33.468141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c5d65-64b6-4fac-b70c-6497408a2f6f None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:33.500385 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c8580-4791-4227-8cc4-834bbe3b6790 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:33.501831 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c8580-4791-4227-8cc4-834bbe3b6790 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:33.529035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:33.567159 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c5d65-64b6-4fac-b70c-6497408a2f6f None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:33.599954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb54a2d-feaa-4bc6-be95-3611beeb2d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:33.600566 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb54a2d-feaa-4bc6-be95-3611beeb2d54 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:33.600837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb54a2d-feaa-4bc6-be95-3611beeb2d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:33.601088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 253/508] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:18:33.601512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb54a2d-feaa-4bc6-be95-3611beeb2d54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:33.601927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c8580-4791-4227-8cc4-834bbe3b6790 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:33.616418 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb54a2d-feaa-4bc6-be95-3611beeb2d54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:33.617847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb54a2d-feaa-4bc6-be95-3611beeb2d54 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:33.632210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-9fb54a2d-feaa-4bc6-be95-3611beeb2d54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:33.632210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:33.632210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:33.632210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:33.632210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:33.632210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:33.632210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:33.632210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:33.632210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:33.632210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:33.632210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:33.632210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:33.632210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:33.632210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:33.632210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:33.632210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:33.633234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:33.633234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:33.633234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:33.633234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:33.633234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:33.633234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:33.633234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:33.633234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:33.633234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:33.633234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:33.633234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:33.633234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:33.633234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:33.633234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:33.633234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:33.633234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:33.633234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:33.634101 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:33.634101 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:33.634101 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:33.634101 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 256/509] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:33.634101 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb54a2d-feaa-4bc6-be95-3611beeb2d54 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:33.646592 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:33.700571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c8580-4791-4227-8cc4-834bbe3b6790 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:33.733923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ab7b3-7d12-4c52-bb0e-663acc507963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:33.734535 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ab7b3-7d12-4c52-bb0e-663acc507963 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:33.734813 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ab7b3-7d12-4c52-bb0e-663acc507963 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:33.735146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ab7b3-7d12-4c52-bb0e-663acc507963 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:33.735800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ab7b3-7d12-4c52-bb0e-663acc507963 None admin] RBAC: Adding query filter params (name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:33.736105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ab7b3-7d12-4c52-bb0e-663acc507963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:33.737466 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ab7b3-7d12-4c52-bb0e-663acc507963 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:33.737555 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb54a2d-feaa-4bc6-be95-3611beeb2d54 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:33.746007 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 254/510] 10.222.0.25 () {56 vars in 1103 bytes} [Sat Sep 24 19:18:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:33.746803 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ab7b3-7d12-4c52-bb0e-663acc507963 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:33.752722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:33.774187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d726b2-9946-4ccc-915a-5c4c18db4965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:33.774880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d726b2-9946-4ccc-915a-5c4c18db4965 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:33.775168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d726b2-9946-4ccc-915a-5c4c18db4965 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:33.775461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d726b2-9946-4ccc-915a-5c4c18db4965 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:33.786161 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d726b2-9946-4ccc-915a-5c4c18db4965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:33.787565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d726b2-9946-4ccc-915a-5c4c18db4965 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:33.802370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-e0d726b2-9946-4ccc-915a-5c4c18db4965 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:33.802370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:33.802370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:33.802370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:33.802370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:33.802370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:33.802370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:33.802370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:33.802370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:33.802370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:33.802370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:33.802370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:33.802370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:33.802370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:33.802370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:33.802370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:33.803473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:33.803473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:33.803473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:33.803473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:33.803473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:33.803473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:33.803473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:33.803473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:33.803473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:33.803473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:33.803473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:33.803473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:33.803473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:33.803473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:33.803473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:33.803473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:33.803473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:33.804528 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:33.804528 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:33.804528 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:33.804528 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 257/511] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:33.804789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d726b2-9946-4ccc-915a-5c4c18db4965 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:33.849475 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ab7b3-7d12-4c52-bb0e-663acc507963 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:33.857103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:33.885525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca513d1-d7ba-424a-b774-78c33d0e416b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:33.886134 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca513d1-d7ba-424a-b774-78c33d0e416b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:33.886417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca513d1-d7ba-424a-b774-78c33d0e416b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:33.886711 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca513d1-d7ba-424a-b774-78c33d0e416b None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:33.887377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca513d1-d7ba-424a-b774-78c33d0e416b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:33.887680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca513d1-d7ba-424a-b774-78c33d0e416b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:33.889054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca513d1-d7ba-424a-b774-78c33d0e416b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:33.901354 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 255/512] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:33.902129 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca513d1-d7ba-424a-b774-78c33d0e416b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:33.908912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d726b2-9946-4ccc-915a-5c4c18db4965 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:33.942303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ea7c6-3c05-46d5-9c61-cf190e03bdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:33.942947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ea7c6-3c05-46d5-9c61-cf190e03bdd2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:33.943222 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ea7c6-3c05-46d5-9c61-cf190e03bdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:33.943486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ea7c6-3c05-46d5-9c61-cf190e03bdd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:33.954360 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ea7c6-3c05-46d5-9c61-cf190e03bdd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:33.955819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ea7c6-3c05-46d5-9c61-cf190e03bdd2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:33.971262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-f97ea7c6-3c05-46d5-9c61-cf190e03bdd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:33.971262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:33.971262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:33.971262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:33.971262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:33.971262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:33.971262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:33.971262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:33.971262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:33.971262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:33.971262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:33.971262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:33.971262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:33.971262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:33.971262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:33.971262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:33.972388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:33.972388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:33.972388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:33.972388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:33.972388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:33.972388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:33.972388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:33.972388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:33.972388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:33.972388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:33.972388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:33.972388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:33.972388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:33.972388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:33.972388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:33.972388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:33.972388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:33.973251 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:33.973251 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:33.973251 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:33.973251 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 258/513] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:33.973251 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ea7c6-3c05-46d5-9c61-cf190e03bdd2 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:33.992034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:34.002153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca513d1-d7ba-424a-b774-78c33d0e416b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:34.038144 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b82f92-d9f9-45a5-8d3b-c2a160920170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:34.038680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b82f92-d9f9-45a5-8d3b-c2a160920170 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:34.039011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b82f92-d9f9-45a5-8d3b-c2a160920170 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:34.039288 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b82f92-d9f9-45a5-8d3b-c2a160920170 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:34.039924 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b82f92-d9f9-45a5-8d3b-c2a160920170 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:34.040226 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b82f92-d9f9-45a5-8d3b-c2a160920170 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:34.042333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b82f92-d9f9-45a5-8d3b-c2a160920170 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:34.058133 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 256/514] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:34.058133 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b82f92-d9f9-45a5-8d3b-c2a160920170 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:34.077317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ea7c6-3c05-46d5-9c61-cf190e03bdd2 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:34.083130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:34.115727 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf6487-5c1b-4d70-ab6b-1c76b4375a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:34.116329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf6487-5c1b-4d70-ab6b-1c76b4375a44 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:34.116610 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf6487-5c1b-4d70-ab6b-1c76b4375a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:34.116877 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf6487-5c1b-4d70-ab6b-1c76b4375a44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:34.128129 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf6487-5c1b-4d70-ab6b-1c76b4375a44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:34.129586 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf6487-5c1b-4d70-ab6b-1c76b4375a44 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:34.144121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-7dcf6487-5c1b-4d70-ab6b-1c76b4375a44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:34.144121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:34.144121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:34.144121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:34.144121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:34.144121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:34.144121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:34.144121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:34.144121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:34.144121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:34.144121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:34.144121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:34.144121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:34.144121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:34.144121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:34.144121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:34.145040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:34.145040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:34.145040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:34.145040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:34.145040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:34.145040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:34.145040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:34.145040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:34.145040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:34.145040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:34.145040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:34.145040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:34.145040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:34.145040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:34.145040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:34.145040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:34.145040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:34.145890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:34.145890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:34.145890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:34.145890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 259/515] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:34.146403 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf6487-5c1b-4d70-ab6b-1c76b4375a44 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:34.162245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b82f92-d9f9-45a5-8d3b-c2a160920170 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:34.196177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80043b63-6d18-4412-9734-2bab3398bd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:34.196784 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80043b63-6d18-4412-9734-2bab3398bd87 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:34.197128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80043b63-6d18-4412-9734-2bab3398bd87 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:34.197472 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80043b63-6d18-4412-9734-2bab3398bd87 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:34.198112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80043b63-6d18-4412-9734-2bab3398bd87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:34.198415 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80043b63-6d18-4412-9734-2bab3398bd87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:34.199819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80043b63-6d18-4412-9734-2bab3398bd87 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:34.211278 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 257/516] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:34.212057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80043b63-6d18-4412-9734-2bab3398bd87 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:34.219272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:34.251580 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf6487-5c1b-4d70-ab6b-1c76b4375a44 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:34.285019 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116022f2-281e-4b05-840b-3c5189b0863b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:34.285666 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116022f2-281e-4b05-840b-3c5189b0863b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:34.285943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116022f2-281e-4b05-840b-3c5189b0863b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:34.286213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116022f2-281e-4b05-840b-3c5189b0863b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:34.293620 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116022f2-281e-4b05-840b-3c5189b0863b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:34.295020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116022f2-281e-4b05-840b-3c5189b0863b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:34.296300 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:34.306689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-116022f2-281e-4b05-840b-3c5189b0863b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:34.306689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:34.306689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:34.306689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:34.306689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:34.306689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:34.306689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:34.306689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:34.306689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:34.306689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:34.306689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:34.306689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:34.306689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:18:34.306689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:18:34.306689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:18:34.308066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:18:34.308066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:34.308066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:34.308066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:34.308066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:34.308066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:34.308066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:34.308066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:34.308066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:34.308066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:34.308066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:34.308066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:34.308066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:34.308066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:34.308066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:34.308066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:34.308066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:34.308937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:18:34.308937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:18:34.308937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:18:34.308937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:18:34.308937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:18:34.308937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:18:34.308937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:34.308937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:34.308937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 260/517] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:34.309473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116022f2-281e-4b05-840b-3c5189b0863b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:34.316714 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80043b63-6d18-4412-9734-2bab3398bd87 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:34.349604 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b5b47-e4ae-4f51-85fc-76073a5a9922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:34.350208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b5b47-e4ae-4f51-85fc-76073a5a9922 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:34.350487 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b5b47-e4ae-4f51-85fc-76073a5a9922 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:34.350763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b5b47-e4ae-4f51-85fc-76073a5a9922 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:34.351447 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b5b47-e4ae-4f51-85fc-76073a5a9922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:34.351751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b5b47-e4ae-4f51-85fc-76073a5a9922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:34.353112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b5b47-e4ae-4f51-85fc-76073a5a9922 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:34.364893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 258/518] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:34.365691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b5b47-e4ae-4f51-85fc-76073a5a9922 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:34.408970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116022f2-281e-4b05-840b-3c5189b0863b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:34.438431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:34.444420 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe70058-d948-4a2b-98bd-016d4dac9375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:34.445045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe70058-d948-4a2b-98bd-016d4dac9375 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:34.445329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe70058-d948-4a2b-98bd-016d4dac9375 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:34.445599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe70058-d948-4a2b-98bd-016d4dac9375 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:34.453129 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe70058-d948-4a2b-98bd-016d4dac9375 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:34.454602 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe70058-d948-4a2b-98bd-016d4dac9375 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:34.465505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-ebe70058-d948-4a2b-98bd-016d4dac9375 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 19:18:34.465505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:34.465505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:34.465505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:34.465505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:34.465505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:34.465505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:34.465505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:34.465505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:34.465505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:34.465505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:34.465505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:34.465505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:18:34.465505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:18:34.465505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:18:34.465505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:18:34.466593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:34.466593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:34.466593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:18:34.466593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:34.466593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:18:34.466593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:34.466593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:34.466593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:34.466593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:34.466593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:34.466593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:34.466593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:34.466593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:34.466593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:34.466593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:34.466593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:34.466593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:34.466593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:34.467744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:34.467744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:34.467744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:18:34.467744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:18:34.467744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:18:34.467744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:18:34.467744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:18:34.467744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:18:34.467744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 19:18:34.467744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:34.467744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 261/519] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:18:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:34.467744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe70058-d948-4a2b-98bd-016d4dac9375 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:34.476832 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b5b47-e4ae-4f51-85fc-76073a5a9922 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:34.511013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34db055-eab2-4fee-895f-54ee3a99b5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:34.511613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34db055-eab2-4fee-895f-54ee3a99b5dd None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:34.511895 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34db055-eab2-4fee-895f-54ee3a99b5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:34.512165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34db055-eab2-4fee-895f-54ee3a99b5dd None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:34.512801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34db055-eab2-4fee-895f-54ee3a99b5dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:34.513103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34db055-eab2-4fee-895f-54ee3a99b5dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:34.514460 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34db055-eab2-4fee-895f-54ee3a99b5dd None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:34.526083 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 259/520] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:34.526898 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34db055-eab2-4fee-895f-54ee3a99b5dd None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:34.534957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:34.567208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe70058-d948-4a2b-98bd-016d4dac9375 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:34.601823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5285b-7621-4f25-b45c-a489ba21b8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:34.602421 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5285b-7621-4f25-b45c-a489ba21b8f0 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:34.602700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5285b-7621-4f25-b45c-a489ba21b8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:34.603007 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5285b-7621-4f25-b45c-a489ba21b8f0 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:34.603685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5285b-7621-4f25-b45c-a489ba21b8f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:34.605213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5285b-7621-4f25-b45c-a489ba21b8f0 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:34.626270 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34db055-eab2-4fee-895f-54ee3a99b5dd None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:34.626785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 262/521] 10.222.0.25 () {60 vars in 1132 bytes} [Sat Sep 24 19:18:34 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:18:34.627141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5285b-7621-4f25-b45c-a489ba21b8f0 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:34.668600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed6af4-788b-4855-85bf-770971b13a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:34.669225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed6af4-788b-4855-85bf-770971b13a2c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:34.669505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed6af4-788b-4855-85bf-770971b13a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:34.669776 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed6af4-788b-4855-85bf-770971b13a2c None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:34.670481 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed6af4-788b-4855-85bf-770971b13a2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:34.670792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed6af4-788b-4855-85bf-770971b13a2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:34.672288 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed6af4-788b-4855-85bf-770971b13a2c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:34.686719 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:34.692819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 260/522] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:18:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:34.693689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed6af4-788b-4855-85bf-770971b13a2c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:34.753728 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5285b-7621-4f25-b45c-a489ba21b8f0 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:34.769104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:34.793380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca372dbe-c90a-41c4-91dc-2def392f08f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:34.794972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca372dbe-c90a-41c4-91dc-2def392f08f3 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:34.795258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca372dbe-c90a-41c4-91dc-2def392f08f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:34.795530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca372dbe-c90a-41c4-91dc-2def392f08f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:34.803232 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca372dbe-c90a-41c4-91dc-2def392f08f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:34.805420 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca372dbe-c90a-41c4-91dc-2def392f08f3 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:34.812118 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed6af4-788b-4855-85bf-770971b13a2c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:34.817919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-ca372dbe-c90a-41c4-91dc-2def392f08f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:34.817919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:34.817919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:34.817919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:34.817919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:34.817919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:34.817919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:34.817919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:34.817919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:34.817919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:34.817919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:34.817919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:34.817919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:18:34.817919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:18:34.817919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:18:34.818785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:18:34.818785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:34.818785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:34.818785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:34.818785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:34.818785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:34.818785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:34.818785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:34.818785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:34.818785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:34.818785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:34.818785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:34.818785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:34.818785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:34.818785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:34.818785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:34.818785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:34.819700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:18:34.819700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:18:34.819700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:18:34.819700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:18:34.819700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:18:34.819700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:18:34.819700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:34.819700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:34.824168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 263/523] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:34.824910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca372dbe-c90a-41c4-91dc-2def392f08f3 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:34.863514 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3385c4-833b-4b61-9335-a9aaff6ca606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:34.864136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3385c4-833b-4b61-9335-a9aaff6ca606 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:34.864744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3385c4-833b-4b61-9335-a9aaff6ca606 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:34.864744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3385c4-833b-4b61-9335-a9aaff6ca606 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:34.865393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3385c4-833b-4b61-9335-a9aaff6ca606 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:34.865695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3385c4-833b-4b61-9335-a9aaff6ca606 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:34.867179 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3385c4-833b-4b61-9335-a9aaff6ca606 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:34.888484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 261/524] 10.222.0.25 () {56 vars in 1139 bytes} [Sat Sep 24 19:18:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:34.888484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3385c4-833b-4b61-9335-a9aaff6ca606 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:34.941546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca372dbe-c90a-41c4-91dc-2def392f08f3 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:34.948816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:34.978200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7b539-fdc7-40fc-9db1-5b2df75eb613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:34.979696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7b539-fdc7-40fc-9db1-5b2df75eb613 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:34.979982 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7b539-fdc7-40fc-9db1-5b2df75eb613 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:34.980254 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7b539-fdc7-40fc-9db1-5b2df75eb613 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:34.987605 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7b539-fdc7-40fc-9db1-5b2df75eb613 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:34.989056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7b539-fdc7-40fc-9db1-5b2df75eb613 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:34.993909 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3385c4-833b-4b61-9335-a9aaff6ca606 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:35.001041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-dca7b539-fdc7-40fc-9db1-5b2df75eb613 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:18:35.001041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:35.001041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:35.001041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:35.001041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:35.001041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:35.001041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:35.001041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:35.001041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:35.001041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:35.001041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:35.001041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:35.001041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:18:35.001041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:18:35.001041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:18:35.001041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:18:35.001954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:35.001954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:35.001954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:18:35.001954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:35.001954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:18:35.001954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:35.001954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:35.001954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:35.001954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:35.001954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:35.001954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:35.001954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:35.001954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:35.001954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:35.001954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:35.001954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:35.001954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:35.001954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:35.002915 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:35.002915 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:35.002915 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:18:35.002915 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:18:35.002915 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:18:35.002915 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:18:35.002915 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:18:35.002915 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:18:35.002915 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:18:35.002915 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:35.002915 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 264/525] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:35.003488 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7b539-fdc7-40fc-9db1-5b2df75eb613 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:35.022658 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:35.036097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a7a7e-6009-4248-97f4-982249a4cffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:35.036714 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a7a7e-6009-4248-97f4-982249a4cffc None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:35.036995 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a7a7e-6009-4248-97f4-982249a4cffc None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:35.037269 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a7a7e-6009-4248-97f4-982249a4cffc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:35.037990 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a7a7e-6009-4248-97f4-982249a4cffc None admin] RBAC: Adding query filter params (role.id=a2673fe5628247c3a918eaa28d483e9f, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=4e5798be0fa544cf9cf48558e87fcfa9) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:35.038300 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a7a7e-6009-4248-97f4-982249a4cffc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:35.039861 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a7a7e-6009-4248-97f4-982249a4cffc None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:35.054871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 262/526] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:18:34 2022] GET /identity/v3/role_assignments?user.id=4e5798be0fa544cf9cf48558e87fcfa9&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=a2673fe5628247c3a918eaa28d483e9f => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:35.054871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a7a7e-6009-4248-97f4-982249a4cffc None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:35.121484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7b539-fdc7-40fc-9db1-5b2df75eb613 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:35.160952 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ee298-e88e-48f8-8e8b-2f66c0cc0f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:35.161629 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ee298-e88e-48f8-8e8b-2f66c0cc0f53 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:35.161908 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ee298-e88e-48f8-8e8b-2f66c0cc0f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:35.162178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ee298-e88e-48f8-8e8b-2f66c0cc0f53 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:35.162979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ee298-e88e-48f8-8e8b-2f66c0cc0f53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:35.163289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ee298-e88e-48f8-8e8b-2f66c0cc0f53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:35.164826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ee298-e88e-48f8-8e8b-2f66c0cc0f53 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:35.187565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 265/527] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:18:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:35.192845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ee298-e88e-48f8-8e8b-2f66c0cc0f53 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:35.198947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a7a7e-6009-4248-97f4-982249a4cffc None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:35.231136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:35.240671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69f754-c51f-4ee5-a2ca-534462cc116e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:35.241539 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69f754-c51f-4ee5-a2ca-534462cc116e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:35.241968 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69f754-c51f-4ee5-a2ca-534462cc116e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:35.242406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69f754-c51f-4ee5-a2ca-534462cc116e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:35.311886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:35.327192 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69f754-c51f-4ee5-a2ca-534462cc116e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:35.328388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ee298-e88e-48f8-8e8b-2f66c0cc0f53 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:35.328999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69f754-c51f-4ee5-a2ca-534462cc116e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:35.376726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e52c3-bf90-41be-8bf3-d19a300cf03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:35.377400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e52c3-bf90-41be-8bf3-d19a300cf03f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:35.377837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e52c3-bf90-41be-8bf3-d19a300cf03f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:35.378228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e52c3-bf90-41be-8bf3-d19a300cf03f None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:35.379446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e52c3-bf90-41be-8bf3-d19a300cf03f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:35.379892 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e52c3-bf90-41be-8bf3-d19a300cf03f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:35.382135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e52c3-bf90-41be-8bf3-d19a300cf03f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:35.407383 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 266/528] 10.222.0.25 () {56 vars in 1137 bytes} [Sat Sep 24 19:18:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:35.409253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e52c3-bf90-41be-8bf3-d19a300cf03f None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:35.463885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 263/529] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:18:35.465461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69f754-c51f-4ee5-a2ca-534462cc116e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:35.515504 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:35.533506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e52c3-bf90-41be-8bf3-d19a300cf03f None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:35.571213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792ca68-e822-4dc5-9e1c-ba34c5c4b185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:35.571435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792ca68-e822-4dc5-9e1c-ba34c5c4b185 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:35.571691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792ca68-e822-4dc5-9e1c-ba34c5c4b185 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:35.571965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792ca68-e822-4dc5-9e1c-ba34c5c4b185 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:35.572748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792ca68-e822-4dc5-9e1c-ba34c5c4b185 None admin] RBAC: Adding query filter params (role.id=a2673fe5628247c3a918eaa28d483e9f, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=54232cb318b04e9286f58dae8b2a3fd4) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:35.573056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792ca68-e822-4dc5-9e1c-ba34c5c4b185 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:35.574542 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792ca68-e822-4dc5-9e1c-ba34c5c4b185 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:35.585023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 267/530] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:18:35 2022] GET /identity/v3/role_assignments?user.id=54232cb318b04e9286f58dae8b2a3fd4&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=a2673fe5628247c3a918eaa28d483e9f => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:35.585023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792ca68-e822-4dc5-9e1c-ba34c5c4b185 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:35.606299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:35.624884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69f754-c51f-4ee5-a2ca-534462cc116e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:35.669483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a8e8f-1d79-4840-bac0-741ef1437a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:35.670873 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a8e8f-1d79-4840-bac0-741ef1437a46 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:35.671306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a8e8f-1d79-4840-bac0-741ef1437a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:35.671749 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a8e8f-1d79-4840-bac0-741ef1437a46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:35.757183 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a8e8f-1d79-4840-bac0-741ef1437a46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:35.758941 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a8e8f-1d79-4840-bac0-741ef1437a46 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:35.843953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792ca68-e822-4dc5-9e1c-ba34c5c4b185 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:35.878048 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:35.899516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 264/531] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:18:35.904714 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a8e8f-1d79-4840-bac0-741ef1437a46 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:35.921721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21c879-ff5c-444e-8591-62cbc513181b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:35.922272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21c879-ff5c-444e-8591-62cbc513181b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:35.922544 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21c879-ff5c-444e-8591-62cbc513181b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:35.922809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21c879-ff5c-444e-8591-62cbc513181b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:35.945458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21c879-ff5c-444e-8591-62cbc513181b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:35.946964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21c879-ff5c-444e-8591-62cbc513181b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:35.968263 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:35.976224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-7f21c879-ff5c-444e-8591-62cbc513181b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:35.976224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:35.976224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:35.976224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:35.976224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:35.976224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:35.976224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:35.976224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:35.976224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:35.976224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:35.976224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:35.976224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:35.976224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:35.976224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:35.976224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:35.976224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:35.977191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:35.977191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:35.977191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:35.977191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:35.977191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:35.977191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:35.977191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:35.977191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:35.977191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:35.977191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:35.977191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:35.977191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:35.977191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:35.977191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:35.977191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:35.977191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:35.977191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:35.978110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:35.978110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:35.978110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:35.979254 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 268/532] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:35.984556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21c879-ff5c-444e-8591-62cbc513181b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:36.116647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a8e8f-1d79-4840-bac0-741ef1437a46 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:36.165202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21c879-ff5c-444e-8591-62cbc513181b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:36.183148 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39318d9-a830-4a18-bc62-61d2c91e1063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:36.183689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39318d9-a830-4a18-bc62-61d2c91e1063 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:36.183970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39318d9-a830-4a18-bc62-61d2c91e1063 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:36.184250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39318d9-a830-4a18-bc62-61d2c91e1063 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:36.201724 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39318d9-a830-4a18-bc62-61d2c91e1063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:36.203223 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39318d9-a830-4a18-bc62-61d2c91e1063 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:36.222795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-d39318d9-a830-4a18-bc62-61d2c91e1063 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:36.222795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:36.222795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:36.222795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:36.222795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:36.222795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:36.222795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:36.222795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:36.222795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:36.222795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:36.222795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:36.222795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:36.222795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:36.222795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:36.222795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:36.222795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:36.223768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:36.223768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:36.223768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:36.223768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:36.223768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:36.223768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:36.223768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:36.223768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:36.223768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:36.223768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:36.223768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:36.223768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:36.223768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:36.223768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:36.223768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:36.223768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:36.223768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:36.224638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:36.224638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:36.224638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:36.224638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 265/533] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:36.234628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8549792-b593-4a9c-b9d7-3b56d1fad5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:36.235315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8549792-b593-4a9c-b9d7-3b56d1fad5ca None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:36.235596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8549792-b593-4a9c-b9d7-3b56d1fad5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:36.235928 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8549792-b593-4a9c-b9d7-3b56d1fad5ca None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:36.236576 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8549792-b593-4a9c-b9d7-3b56d1fad5ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:36.236882 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8549792-b593-4a9c-b9d7-3b56d1fad5ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:36.238261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8549792-b593-4a9c-b9d7-3b56d1fad5ca None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:36.240122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39318d9-a830-4a18-bc62-61d2c91e1063 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:36.268819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 269/534] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:36.274353 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8549792-b593-4a9c-b9d7-3b56d1fad5ca None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:36.342130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:36.355178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:36.388571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8549792-b593-4a9c-b9d7-3b56d1fad5ca None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:36.433446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e60527-4f7c-48b4-af8a-d01343f8fdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:36.434409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e60527-4f7c-48b4-af8a-d01343f8fdfd None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:36.434959 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e60527-4f7c-48b4-af8a-d01343f8fdfd None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:36.435449 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e60527-4f7c-48b4-af8a-d01343f8fdfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:36.443512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e60527-4f7c-48b4-af8a-d01343f8fdfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:36.445218 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e60527-4f7c-48b4-af8a-d01343f8fdfd None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:36.459937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-b0e60527-4f7c-48b4-af8a-d01343f8fdfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:36.459937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:36.459937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:36.459937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:36.459937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:36.459937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:36.459937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:36.459937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:36.459937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:36.459937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:36.459937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:36.459937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:36.459937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:18:36.459937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:18:36.459937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:18:36.460843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:18:36.460843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:36.460843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:36.460843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:36.460843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:36.460843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:36.460843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:36.460843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:36.460843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:36.460843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:36.460843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:36.460843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:36.460843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:36.460843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:36.460843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:36.460843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:36.460843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:36.461678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:18:36.461678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:18:36.461678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:18:36.461678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:18:36.461678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:18:36.461678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:18:36.461678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:36.461678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:36.464839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 270/535] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:18:36.470560 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e60527-4f7c-48b4-af8a-d01343f8fdfd None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:36.487279 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39318d9-a830-4a18-bc62-61d2c91e1063 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:36.581560 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e60527-4f7c-48b4-af8a-d01343f8fdfd None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:36.598726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb96384-ec64-4198-8448-f1c0dce31d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:36.599832 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb96384-ec64-4198-8448-f1c0dce31d74 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:36.601265 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb96384-ec64-4198-8448-f1c0dce31d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:36.601767 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb96384-ec64-4198-8448-f1c0dce31d74 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:36.604322 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb96384-ec64-4198-8448-f1c0dce31d74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:36.604843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb96384-ec64-4198-8448-f1c0dce31d74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:36.607441 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb96384-ec64-4198-8448-f1c0dce31d74 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:36.627208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:36.635947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 266/536] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:36.639184 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fe99d-5d42-4f06-adfb-2398e4d760a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:36.639876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fe99d-5d42-4f06-adfb-2398e4d760a2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:36.640350 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fe99d-5d42-4f06-adfb-2398e4d760a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:36.641265 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb96384-ec64-4198-8448-f1c0dce31d74 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:36.641855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fe99d-5d42-4f06-adfb-2398e4d760a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:36.645642 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fe99d-5d42-4f06-adfb-2398e4d760a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:36.645962 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fe99d-5d42-4f06-adfb-2398e4d760a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:36.649776 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fe99d-5d42-4f06-adfb-2398e4d760a2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:36.674490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 271/537] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:18:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:36.684327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fe99d-5d42-4f06-adfb-2398e4d760a2 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:36.807556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb96384-ec64-4198-8448-f1c0dce31d74 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:36.836524 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:36.854536 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd27b17-3769-442e-a80e-a45a32477fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:36.855208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd27b17-3769-442e-a80e-a45a32477fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:36.855490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd27b17-3769-442e-a80e-a45a32477fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:36.855764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd27b17-3769-442e-a80e-a45a32477fe7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:36.864041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd27b17-3769-442e-a80e-a45a32477fe7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:36.866064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd27b17-3769-442e-a80e-a45a32477fe7 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:36.880117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-ebd27b17-3769-442e-a80e-a45a32477fe7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:36.880117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:36.880117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:36.880117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:36.880117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:36.880117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:36.880117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:36.880117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:36.880117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:36.880117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:36.880117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:36.880117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:36.880117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:18:36.880117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:18:36.880117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:18:36.881068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:18:36.881068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:36.881068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:36.881068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:36.881068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:36.881068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:36.881068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:36.881068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:36.881068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:36.881068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:36.881068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:36.881068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:36.881068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:36.881068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:36.881068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:36.881068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:36.881068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:36.881932 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:18:36.881932 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:18:36.881932 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:18:36.881932 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:18:36.881932 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:18:36.881932 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:18:36.881932 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:36.881932 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:36.881932 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 267/538] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:18:36.888391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd27b17-3769-442e-a80e-a45a32477fe7 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:36.908207 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fe99d-5d42-4f06-adfb-2398e4d760a2 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:36.949092 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558970d-87ad-4594-9142-168b5c9b5dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:36.949837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558970d-87ad-4594-9142-168b5c9b5dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:36.950128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558970d-87ad-4594-9142-168b5c9b5dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:36.950410 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558970d-87ad-4594-9142-168b5c9b5dd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:36.951189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558970d-87ad-4594-9142-168b5c9b5dd9 None admin] RBAC: Adding query filter params (role.id=a2673fe5628247c3a918eaa28d483e9f, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=1763ed41f99a4778b3df6eebcc6d94e8) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:36.951508 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558970d-87ad-4594-9142-168b5c9b5dd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:36.952993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558970d-87ad-4594-9142-168b5c9b5dd9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:36.959798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 272/539] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:18:36 2022] GET /identity/v3/role_assignments?user.id=1763ed41f99a4778b3df6eebcc6d94e8&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=a2673fe5628247c3a918eaa28d483e9f => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:37.064065 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce993c6b-2417-49e9-8568-261900ffcd62 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:37.064408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce993c6b-2417-49e9-8568-261900ffcd62 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:37.064627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce993c6b-2417-49e9-8568-261900ffcd62 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:37.066509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 273/540] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:18:37.072286 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c921f66-4afb-4c33-82d4-4ca938ff6034 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:37.073143 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c921f66-4afb-4c33-82d4-4ca938ff6034 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:37.073753 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c921f66-4afb-4c33-82d4-4ca938ff6034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:37.103021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd27b17-3769-442e-a80e-a45a32477fe7 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:37.113209 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-4c921f66-4afb-4c33-82d4-4ca938ff6034 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:37.114515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4c921f66-4afb-4c33-82d4-4ca938ff6034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:37.174531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e81ee1-5c27-4832-8e35-d52a32a3f527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:37.175178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e81ee1-5c27-4832-8e35-d52a32a3f527 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:37.175455 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e81ee1-5c27-4832-8e35-d52a32a3f527 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:37.175728 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e81ee1-5c27-4832-8e35-d52a32a3f527 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:37.176424 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e81ee1-5c27-4832-8e35-d52a32a3f527 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:37.176730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e81ee1-5c27-4832-8e35-d52a32a3f527 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:37.178182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e81ee1-5c27-4832-8e35-d52a32a3f527 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:37.197152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 268/541] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:18:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:37.200044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:37.203180 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e81ee1-5c27-4832-8e35-d52a32a3f527 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:37.228415 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 274/542] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:18:37.244615 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:37.349317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e81ee1-5c27-4832-8e35-d52a32a3f527 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:37.386003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39ceba-71a8-43d7-92b1-556a357d255f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:37.387062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39ceba-71a8-43d7-92b1-556a357d255f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:37.387545 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39ceba-71a8-43d7-92b1-556a357d255f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:37.388056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39ceba-71a8-43d7-92b1-556a357d255f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:37.389006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39ceba-71a8-43d7-92b1-556a357d255f None admin] RBAC: Adding query filter params (role.id=a2673fe5628247c3a918eaa28d483e9f, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=5840a13ddf8c45f2bf97a4f6d4a48d96) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:37.389514 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39ceba-71a8-43d7-92b1-556a357d255f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:37.391183 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39ceba-71a8-43d7-92b1-556a357d255f None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:37.397698 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 269/543] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:18:37 2022] GET /identity/v3/role_assignments?user.id=5840a13ddf8c45f2bf97a4f6d4a48d96&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=a2673fe5628247c3a918eaa28d483e9f => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:37.539874 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169588bd-2846-4afd-b957-20483dfe1622 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:37.540220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169588bd-2846-4afd-b957-20483dfe1622 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:37.540458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169588bd-2846-4afd-b957-20483dfe1622 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:37.542632 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 275/544] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:37.548711 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fab8ee-190c-4fb7-b1e3-f8fe3401c899 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:37.549004 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fab8ee-190c-4fb7-b1e3-f8fe3401c899 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:37.549114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169588bd-2846-4afd-b957-20483dfe1622 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:37.549272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fab8ee-190c-4fb7-b1e3-f8fe3401c899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:37.581113 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-66fab8ee-190c-4fb7-b1e3-f8fe3401c899 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:37.582354 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-66fab8ee-190c-4fb7-b1e3-f8fe3401c899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:37.685086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 270/545] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:37.708998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169588bd-2846-4afd-b957-20483dfe1622 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:37.746201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0dbee-e99f-4824-8e1b-5a6bb967cc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:37.746851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0dbee-e99f-4824-8e1b-5a6bb967cc53 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:37.747136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0dbee-e99f-4824-8e1b-5a6bb967cc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:37.747411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0dbee-e99f-4824-8e1b-5a6bb967cc53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:37.758354 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0dbee-e99f-4824-8e1b-5a6bb967cc53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:37.763397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-a7b0dbee-e99f-4824-8e1b-5a6bb967cc53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:37.763397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:37.763397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:37.763397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:37.763397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:37.763397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:37.763397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:37.763397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:37.763397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:37.763397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:37.763397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:37.763397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:37.763397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:37.763397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:37.763397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:37.763397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:37.764293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:37.764293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:37.764293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:37.764293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:37.764293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:37.764293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:37.764293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:37.764293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:37.764293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:37.764293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:37.764293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:37.764293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:37.764293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:37.764293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:37.764293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:37.764293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:37.765086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:37.765086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:37.765086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:37.765086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:37.765086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:37.765086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:37.765086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:37.765086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:37.765086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:37.765086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:37.765086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:37.765086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:37.765086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 276/546] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:18:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:37.770790 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fab8ee-190c-4fb7-b1e3-f8fe3401c899 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:37.787604 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:37.895400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fab8ee-190c-4fb7-b1e3-f8fe3401c899 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:37.932438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be179456-23c0-48ad-af0f-e56163ccd738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:37.933059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be179456-23c0-48ad-af0f-e56163ccd738 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:37.933337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be179456-23c0-48ad-af0f-e56163ccd738 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:37.933612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be179456-23c0-48ad-af0f-e56163ccd738 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:37.934279 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be179456-23c0-48ad-af0f-e56163ccd738 None admin] RBAC: Adding query filter params (name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:37.934586 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be179456-23c0-48ad-af0f-e56163ccd738 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:37.935995 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be179456-23c0-48ad-af0f-e56163ccd738 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:37.944937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 271/547] 10.222.0.25 () {56 vars in 1103 bytes} [Sat Sep 24 19:18:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:37.950731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0dbee-e99f-4824-8e1b-5a6bb967cc53 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:37.993334 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:38.005686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be179456-23c0-48ad-af0f-e56163ccd738 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:38.117187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:38.122866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0dbee-e99f-4824-8e1b-5a6bb967cc53 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:38.161489 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be179456-23c0-48ad-af0f-e56163ccd738 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:38.165251 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9afcca-d6b7-4771-9b14-1893fc218f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:38.166460 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9afcca-d6b7-4771-9b14-1893fc218f5a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:38.166802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9afcca-d6b7-4771-9b14-1893fc218f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:38.167303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9afcca-d6b7-4771-9b14-1893fc218f5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:38.178095 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9afcca-d6b7-4771-9b14-1893fc218f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:38.179757 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9afcca-d6b7-4771-9b14-1893fc218f5a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:38.204701 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1476d6c-98e5-4768-adcf-8d2b064b5279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:38.205687 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1476d6c-98e5-4768-adcf-8d2b064b5279 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:38.206116 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1476d6c-98e5-4768-adcf-8d2b064b5279 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:38.206567 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1476d6c-98e5-4768-adcf-8d2b064b5279 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:38.214857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-fe9afcca-d6b7-4771-9b14-1893fc218f5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:38.214857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:38.214857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:38.214857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:38.214857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:38.214857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:38.214857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:38.214857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:38.214857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:38.214857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:38.214857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:38.214857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:38.214857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:38.214857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:38.214857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:38.214857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:38.216037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:38.216037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:38.216037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:38.216037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:38.216037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:38.216037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:38.216037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:38.216037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:38.216037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:38.216037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:38.216037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:38.216037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:38.216037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:38.216037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:38.216037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:38.216037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:38.216037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:38.217012 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:38.217012 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:38.217012 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:38.217012 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 277/548] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:38.223817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9afcca-d6b7-4771-9b14-1893fc218f5a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:38.241188 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1476d6c-98e5-4768-adcf-8d2b064b5279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:38.250072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-b1476d6c-98e5-4768-adcf-8d2b064b5279 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:38.250072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:38.250072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:38.250072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:38.250072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:38.250072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:38.250072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:38.250072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:38.250072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:38.250072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:38.250072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:38.250072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:38.250072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:38.250072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:38.250072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:38.250072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:38.251634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:38.251634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:38.251634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:38.251634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:38.251634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:38.251634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:38.251634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:38.251634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:38.251634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:38.251634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:38.251634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:38.251634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:38.251634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:38.251634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:38.251634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:38.251634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:38.252638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:38.252638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:38.252638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:38.252638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:38.252638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:38.252638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:38.252638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:38.252638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:38.252638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:38.252638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:38.252638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:38.252638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:38.252638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 272/549] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:18:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:18:38.261110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1476d6c-98e5-4768-adcf-8d2b064b5279 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:38.377088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:38.394422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9afcca-d6b7-4771-9b14-1893fc218f5a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:38.413811 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1476d6c-98e5-4768-adcf-8d2b064b5279 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:38.434943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7ec12-b9c4-47f1-a1f1-7703407acca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:38.435555 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7ec12-b9c4-47f1-a1f1-7703407acca5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:38.435830 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7ec12-b9c4-47f1-a1f1-7703407acca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:38.436098 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7ec12-b9c4-47f1-a1f1-7703407acca5 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:38.436731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7ec12-b9c4-47f1-a1f1-7703407acca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:38.437211 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7ec12-b9c4-47f1-a1f1-7703407acca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:38.439361 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7ec12-b9c4-47f1-a1f1-7703407acca5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:38.452734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 278/550] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:38.453932 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653046fb-00b8-4f65-8eca-1456e1b96760 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:38.454212 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653046fb-00b8-4f65-8eca-1456e1b96760 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:38.454484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653046fb-00b8-4f65-8eca-1456e1b96760 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:38.456298 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 279/551] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:38.457751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653046fb-00b8-4f65-8eca-1456e1b96760 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:38.466705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55004055-215b-46d2-b79b-bf02a3450751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:38.467349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55004055-215b-46d2-b79b-bf02a3450751 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:38.468121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55004055-215b-46d2-b79b-bf02a3450751 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:38.468420 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55004055-215b-46d2-b79b-bf02a3450751 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:38.469091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55004055-215b-46d2-b79b-bf02a3450751 None admin] RBAC: Adding query filter params (name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:38.469391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55004055-215b-46d2-b79b-bf02a3450751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:38.471240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55004055-215b-46d2-b79b-bf02a3450751 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:38.474467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:38.484124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 273/552] 10.222.0.25 () {56 vars in 1103 bytes} [Sat Sep 24 19:18:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:38.485851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f4465-956d-4b6d-9a8d-c2785fcffad3 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:38.486137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f4465-956d-4b6d-9a8d-c2785fcffad3 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:38.486864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f4465-956d-4b6d-9a8d-c2785fcffad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:38.508692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-6e8f4465-956d-4b6d-9a8d-c2785fcffad3 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:38.510151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6e8f4465-956d-4b6d-9a8d-c2785fcffad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:38.581962 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 274/553] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:38.583088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f4465-956d-4b6d-9a8d-c2785fcffad3 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:38.599478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653046fb-00b8-4f65-8eca-1456e1b96760 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:38.663365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46364b3c-a2a3-4fcd-ad34-7b744f0b4bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:38.664048 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46364b3c-a2a3-4fcd-ad34-7b744f0b4bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:38.664265 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46364b3c-a2a3-4fcd-ad34-7b744f0b4bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:38.664533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46364b3c-a2a3-4fcd-ad34-7b744f0b4bc5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:38.677725 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46364b3c-a2a3-4fcd-ad34-7b744f0b4bc5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:38.679195 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46364b3c-a2a3-4fcd-ad34-7b744f0b4bc5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:38.700967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-46364b3c-a2a3-4fcd-ad34-7b744f0b4bc5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:18:38.700967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:38.700967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:38.700967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:38.700967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:38.700967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:38.700967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:38.700967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:38.700967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:38.700967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:38.700967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:38.700967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:38.700967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:18:38.700967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:18:38.700967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:18:38.700967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:18:38.702045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:38.702045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:38.702045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:18:38.702045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:38.702045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:18:38.702045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:38.702045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:38.702045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:38.702045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:38.702045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:38.702045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:38.702045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:38.702045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:38.702045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:38.702045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:38.702045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:38.702045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:38.702045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:38.703014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:38.703014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:38.703014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:18:38.703014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:18:38.703014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:18:38.703014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:18:38.703014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:18:38.703014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:18:38.703014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:18:38.703014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:38.708415 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 280/554] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:18:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:38.713930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46364b3c-a2a3-4fcd-ad34-7b744f0b4bc5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:38.747213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:38.781483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f4465-956d-4b6d-9a8d-c2785fcffad3 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:38.826486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:38.843400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53367c7a-7873-4057-a951-572c69b007bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:38.844042 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53367c7a-7873-4057-a951-572c69b007bb None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:38.844319 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53367c7a-7873-4057-a951-572c69b007bb None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:38.844591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53367c7a-7873-4057-a951-572c69b007bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:38.863455 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53367c7a-7873-4057-a951-572c69b007bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:38.864932 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53367c7a-7873-4057-a951-572c69b007bb None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:38.898343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-53367c7a-7873-4057-a951-572c69b007bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:38.898343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:38.898343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:38.898343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:38.898343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:38.898343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:38.898343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:38.898343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:38.898343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:38.898343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:38.898343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:38.898343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:38.898343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:38.898343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:38.898343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:38.898343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:38.900139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:38.900139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:38.900139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:38.900139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:38.900139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:38.900139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:38.900139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:38.900139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:38.900139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:38.900139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:38.900139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:38.900139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:38.900139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:38.900139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:38.900139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:38.900139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:38.900139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:38.901613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:38.901613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:38.901613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:38.903636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 275/555] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:38.904704 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46364b3c-a2a3-4fcd-ad34-7b744f0b4bc5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:38.904950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53367c7a-7873-4057-a951-572c69b007bb None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:38.946028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571c2da-3b63-4997-9ef6-9da25d7db2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:38.946667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571c2da-3b63-4997-9ef6-9da25d7db2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:38.946667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571c2da-3b63-4997-9ef6-9da25d7db2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:38.946990 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571c2da-3b63-4997-9ef6-9da25d7db2c0 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:38.948312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571c2da-3b63-4997-9ef6-9da25d7db2c0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:38.948894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571c2da-3b63-4997-9ef6-9da25d7db2c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:38.951311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571c2da-3b63-4997-9ef6-9da25d7db2c0 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:38.973188 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 281/556] 10.222.0.25 () {56 vars in 1135 bytes} [Sat Sep 24 19:18:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:38.974065 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571c2da-3b63-4997-9ef6-9da25d7db2c0 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:39.023348 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53367c7a-7873-4057-a951-572c69b007bb None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:39.062012 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02cabd-0c15-45f9-b492-147f012b8487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:39.063042 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02cabd-0c15-45f9-b492-147f012b8487 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:39.063549 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02cabd-0c15-45f9-b492-147f012b8487 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:39.064025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02cabd-0c15-45f9-b492-147f012b8487 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:39.065153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:39.076090 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02cabd-0c15-45f9-b492-147f012b8487 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:39.082894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-1b02cabd-0c15-45f9-b492-147f012b8487 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:39.082894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:39.082894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:39.082894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:39.082894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:39.082894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:39.082894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:39.082894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:39.082894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:39.082894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:39.082894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:39.082894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:39.082894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:39.082894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:39.082894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:39.082894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:39.084299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:39.084299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:39.084299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:39.084299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:39.084299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:39.084299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:39.084299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:39.084299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:39.084299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:39.084299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:39.084299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:39.084299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:39.084299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:39.084299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:39.084299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:39.084299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:39.085167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:39.085167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:39.085167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:39.085167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:39.085167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:39.085167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:39.085167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:39.085167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:39.085167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:39.085167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:39.085167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:39.085167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:39.085167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 276/557] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:18:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:39.085167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02cabd-0c15-45f9-b492-147f012b8487 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:39.111295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571c2da-3b63-4997-9ef6-9da25d7db2c0 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:39.129947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:39.156799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0841547-3b99-425d-b7e8-cff408684a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:39.157889 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0841547-3b99-425d-b7e8-cff408684a4b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:39.158347 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0841547-3b99-425d-b7e8-cff408684a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:39.159308 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0841547-3b99-425d-b7e8-cff408684a4b None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:39.160405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0841547-3b99-425d-b7e8-cff408684a4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:39.160893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0841547-3b99-425d-b7e8-cff408684a4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:39.163275 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0841547-3b99-425d-b7e8-cff408684a4b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:39.181912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 282/558] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:39.183059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0841547-3b99-425d-b7e8-cff408684a4b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:39.200539 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02cabd-0c15-45f9-b492-147f012b8487 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:39.244897 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f987a91-b5c4-4f1e-9ea3-692292118565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:39.245641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f987a91-b5c4-4f1e-9ea3-692292118565 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:39.245924 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f987a91-b5c4-4f1e-9ea3-692292118565 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:39.246198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f987a91-b5c4-4f1e-9ea3-692292118565 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:39.307434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0841547-3b99-425d-b7e8-cff408684a4b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:39.336701 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f987a91-b5c4-4f1e-9ea3-692292118565 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:39.339020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f987a91-b5c4-4f1e-9ea3-692292118565 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:39.340889 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:39.353979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838eb92b-9e5c-46c7-bd7c-05143d7c4f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:39.355542 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838eb92b-9e5c-46c7-bd7c-05143d7c4f61 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:39.357634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838eb92b-9e5c-46c7-bd7c-05143d7c4f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:39.357910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838eb92b-9e5c-46c7-bd7c-05143d7c4f61 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:39.358572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838eb92b-9e5c-46c7-bd7c-05143d7c4f61 None admin] RBAC: Adding query filter params (name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:39.358897 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838eb92b-9e5c-46c7-bd7c-05143d7c4f61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:39.360272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838eb92b-9e5c-46c7-bd7c-05143d7c4f61 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:39.369389 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 283/559] 10.222.0.25 () {56 vars in 1103 bytes} [Sat Sep 24 19:18:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:39.370436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838eb92b-9e5c-46c7-bd7c-05143d7c4f61 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:39.393295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:39.458171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 277/560] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:18:39.459421 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f987a91-b5c4-4f1e-9ea3-692292118565 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:39.482489 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838eb92b-9e5c-46c7-bd7c-05143d7c4f61 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:39.523140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355a615-bd9b-446c-9c82-4ff0cd64b8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:39.524050 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355a615-bd9b-446c-9c82-4ff0cd64b8ca None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:39.524330 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355a615-bd9b-446c-9c82-4ff0cd64b8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:39.524606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355a615-bd9b-446c-9c82-4ff0cd64b8ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:39.534064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355a615-bd9b-446c-9c82-4ff0cd64b8ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:39.535812 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355a615-bd9b-446c-9c82-4ff0cd64b8ca None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:39.549064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-4355a615-bd9b-446c-9c82-4ff0cd64b8ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:18:39.549064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:39.549064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:39.549064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:39.549064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:39.549064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:39.549064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:39.549064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:39.549064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:39.549064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:39.549064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:39.549064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:39.549064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:18:39.549064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:18:39.549064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:18:39.549064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:18:39.550091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:39.550091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:39.550091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:18:39.550091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:39.550091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:18:39.550091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:39.550091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:39.550091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:39.550091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:39.550091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:39.550091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:39.550091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:39.550091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:39.550091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:39.550091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:39.550091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:39.550091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:39.550091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:39.551093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:39.551093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:39.551093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:18:39.551093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:18:39.551093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:18:39.551093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:18:39.551093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:18:39.551093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:18:39.551093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:18:39.551093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:39.555128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 284/561] 10.222.0.25 () {56 vars in 1093 bytes} [Sat Sep 24 19:18:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:39.556139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355a615-bd9b-446c-9c82-4ff0cd64b8ca None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:39.575616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f987a91-b5c4-4f1e-9ea3-692292118565 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:39.613144 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:39.614434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05856e1-6beb-4fb6-b12a-caa19689034b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:39.615624 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05856e1-6beb-4fb6-b12a-caa19689034b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:39.616087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05856e1-6beb-4fb6-b12a-caa19689034b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:39.616509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05856e1-6beb-4fb6-b12a-caa19689034b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:39.626203 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:39.628618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05856e1-6beb-4fb6-b12a-caa19689034b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:39.630373 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05856e1-6beb-4fb6-b12a-caa19689034b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:39.647229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-a05856e1-6beb-4fb6-b12a-caa19689034b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:39.647229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:39.647229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:39.647229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:39.647229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:39.647229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:39.647229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:39.647229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:39.647229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:39.647229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:39.647229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:39.647229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:39.647229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:39.647229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:39.647229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:39.647229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:39.648458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:39.648458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:39.648458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:39.648458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:39.648458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:39.648458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:39.648458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:39.648458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:39.648458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:39.648458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:39.648458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:39.648458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:39.648458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:39.648458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:39.648458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:39.648458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:39.648458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:39.649705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:39.649705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:39.649705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:39.649886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 278/562] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:39.651426 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05856e1-6beb-4fb6-b12a-caa19689034b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:39.685145 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355a615-bd9b-446c-9c82-4ff0cd64b8ca None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:39.723261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f3f5e-b75c-43f5-a448-b5c453aa0597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:39.724194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f3f5e-b75c-43f5-a448-b5c453aa0597 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:39.724194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f3f5e-b75c-43f5-a448-b5c453aa0597 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:39.724404 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f3f5e-b75c-43f5-a448-b5c453aa0597 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:39.739479 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f3f5e-b75c-43f5-a448-b5c453aa0597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:39.740956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f3f5e-b75c-43f5-a448-b5c453aa0597 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:39.758013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-455f3f5e-b75c-43f5-a448-b5c453aa0597 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:39.758013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:39.758013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:39.758013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:39.758013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:39.758013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:39.758013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:39.758013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:39.758013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:39.758013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:39.758013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:39.758013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:39.758013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:39.758013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:39.758013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:39.758013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:39.759111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:39.759111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:39.759111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:39.759111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:39.759111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:39.759111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:39.759111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:39.759111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:39.759111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:39.759111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:39.759111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:39.759111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:39.759111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:39.759111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:39.759111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:39.759111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:39.759111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:39.760795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:39.760795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:39.760795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:39.760795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 285/563] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:39.760795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f3f5e-b75c-43f5-a448-b5c453aa0597 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:39.768848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05856e1-6beb-4fb6-b12a-caa19689034b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:39.807351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce9434-73c6-484a-be59-5e32d5052286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:39.807964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce9434-73c6-484a-be59-5e32d5052286 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:39.808242 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce9434-73c6-484a-be59-5e32d5052286 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:39.808511 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce9434-73c6-484a-be59-5e32d5052286 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:39.809234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce9434-73c6-484a-be59-5e32d5052286 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:39.809542 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce9434-73c6-484a-be59-5e32d5052286 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:39.810995 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce9434-73c6-484a-be59-5e32d5052286 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:39.828894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 279/564] 10.222.0.25 () {56 vars in 1133 bytes} [Sat Sep 24 19:18:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:39.830133 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217aa48d-3deb-49dd-9365-e51f98d519b4 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:39.830417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217aa48d-3deb-49dd-9365-e51f98d519b4 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:39.830690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217aa48d-3deb-49dd-9365-e51f98d519b4 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:39.834886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 280/565] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:39.834886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217aa48d-3deb-49dd-9365-e51f98d519b4 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:39.873042 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:39.877439 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f3f5e-b75c-43f5-a448-b5c453aa0597 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:39.884969 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:39.910865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1caffc-d4d7-4eb4-8c34-7635f7a21781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:39.911472 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1caffc-d4d7-4eb4-8c34-7635f7a21781 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:39.911751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1caffc-d4d7-4eb4-8c34-7635f7a21781 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:39.912020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1caffc-d4d7-4eb4-8c34-7635f7a21781 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:39.912647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1caffc-d4d7-4eb4-8c34-7635f7a21781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:39.912945 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1caffc-d4d7-4eb4-8c34-7635f7a21781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:39.914298 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1caffc-d4d7-4eb4-8c34-7635f7a21781 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:39.926875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 286/566] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:39.927625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1caffc-d4d7-4eb4-8c34-7635f7a21781 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:39.937431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217aa48d-3deb-49dd-9365-e51f98d519b4 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:39.971573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f234b6e-44b6-4b99-adb9-44bff3894df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:39.972178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f234b6e-44b6-4b99-adb9-44bff3894df6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:39.972457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f234b6e-44b6-4b99-adb9-44bff3894df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:39.972732 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f234b6e-44b6-4b99-adb9-44bff3894df6 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:39.973416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f234b6e-44b6-4b99-adb9-44bff3894df6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:39.973666 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f234b6e-44b6-4b99-adb9-44bff3894df6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:39.975049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f234b6e-44b6-4b99-adb9-44bff3894df6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:39.986962 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 281/567] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:39.988125 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e6581-8b1f-4d6b-9898-6cc9c43c5d9b None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:39.988408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e6581-8b1f-4d6b-9898-6cc9c43c5d9b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:39.988682 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e6581-8b1f-4d6b-9898-6cc9c43c5d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:40.005903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-942e6581-8b1f-4d6b-9898-6cc9c43c5d9b None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:40.007120 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-942e6581-8b1f-4d6b-9898-6cc9c43c5d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:40.028749 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1caffc-d4d7-4eb4-8c34-7635f7a21781 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:40.064277 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28806030-a3a2-4cec-943b-20913c386543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:40.064905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28806030-a3a2-4cec-943b-20913c386543 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:40.065182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28806030-a3a2-4cec-943b-20913c386543 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:40.065453 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28806030-a3a2-4cec-943b-20913c386543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:40.074535 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 282/568] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:40.075772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28806030-a3a2-4cec-943b-20913c386543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:40.075923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f609a1-99df-4e69-b5a6-b2322b3880e3 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:40.076106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f609a1-99df-4e69-b5a6-b2322b3880e3 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:40.076383 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f609a1-99df-4e69-b5a6-b2322b3880e3 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:40.077268 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28806030-a3a2-4cec-943b-20913c386543 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:40.081794 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 283/569] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:40.082548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f609a1-99df-4e69-b5a6-b2322b3880e3 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:40.094379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-28806030-a3a2-4cec-943b-20913c386543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:40.094379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:40.094379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:40.094379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:40.094379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:40.094379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:40.094379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:40.094379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:40.094379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:40.094379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:40.094379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:40.094379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:40.094379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:40.094379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:40.094379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:40.094379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:40.095365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:40.095365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:40.095365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:40.095365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:40.095365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:40.095365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:40.095365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:40.095365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:40.095365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:40.095365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:40.095365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:40.095365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:40.095365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:40.095365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:40.095365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:40.095365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:40.095365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:40.096285 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:40.096285 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:40.096285 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:40.100656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 287/570] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:40.101785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28806030-a3a2-4cec-943b-20913c386543 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:40.115265 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:40.131192 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:40.194261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f609a1-99df-4e69-b5a6-b2322b3880e3 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:40.208500 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28806030-a3a2-4cec-943b-20913c386543 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:40.230435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d2b70-7d16-4fb5-aa2a-64960d352672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:40.231203 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d2b70-7d16-4fb5-aa2a-64960d352672 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:40.231488 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d2b70-7d16-4fb5-aa2a-64960d352672 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:40.231762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d2b70-7d16-4fb5-aa2a-64960d352672 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:40.239361 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d2b70-7d16-4fb5-aa2a-64960d352672 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:40.240800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d2b70-7d16-4fb5-aa2a-64960d352672 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:40.242429 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af69518-5665-4200-af2c-1709fd568388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:40.243084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af69518-5665-4200-af2c-1709fd568388 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:40.243365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af69518-5665-4200-af2c-1709fd568388 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:40.243647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af69518-5665-4200-af2c-1709fd568388 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:40.253273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af69518-5665-4200-af2c-1709fd568388 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:40.254397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-ab7d2b70-7d16-4fb5-aa2a-64960d352672 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 24 19:18:40.254397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:40.254397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:40.254397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:40.254397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:40.254397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:40.254397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:40.254397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:40.254397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:40.254397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:40.254397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:40.254397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:40.254397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:18:40.254397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:18:40.254397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:18:40.254397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:18:40.255533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:40.255533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:40.255533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:18:40.255533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:40.255533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:18:40.255533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:40.255533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:40.255533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:40.255533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:40.255533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:40.255533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:40.255533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:40.255533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:40.255533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:40.255533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:40.255533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:40.255533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:40.255533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:40.256594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:40.256594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:40.256594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:18:40.256594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:18:40.256594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:18:40.256594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:18:40.256594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:18:40.256594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:18:40.256594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 24 19:18:40.256594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:40.256594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 284/571] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:40.257189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09927d-f9ca-4342-87d4-2b91a454c5d1 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:40.257264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09927d-f9ca-4342-87d4-2b91a454c5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:40.257512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09927d-f9ca-4342-87d4-2b91a454c5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:40.258077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af69518-5665-4200-af2c-1709fd568388 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:40.272594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-2af69518-5665-4200-af2c-1709fd568388 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:40.272594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:40.272594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:40.272594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:40.272594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:40.272594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:40.272594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:40.272594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:40.272594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:40.272594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:40.272594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:40.272594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:40.272594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:18:40.272594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:18:40.272594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:18:40.273929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:18:40.273929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:40.273929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:40.273929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:40.273929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:40.273929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:40.273929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:40.273929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:40.273929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:40.273929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:40.273929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:40.273929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:40.273929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:40.273929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:40.273929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:40.273929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:40.273929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:40.275053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:18:40.275053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:18:40.275053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:18:40.275053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:18:40.275053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:18:40.275053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:18:40.275053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:40.275053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:40.276346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-ac09927d-f9ca-4342-87d4-2b91a454c5d1 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:40.277290 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 288/572] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:40.277544 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ac09927d-f9ca-4342-87d4-2b91a454c5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:40.278353 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af69518-5665-4200-af2c-1709fd568388 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:40.352738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 285/573] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:40.354235 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09927d-f9ca-4342-87d4-2b91a454c5d1 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:40.361315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:40.385548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:40.395472 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af69518-5665-4200-af2c-1709fd568388 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:40.436775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533afd0-8819-42ef-8ec2-6dec422052e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:40.437385 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533afd0-8819-42ef-8ec2-6dec422052e9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:40.437664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533afd0-8819-42ef-8ec2-6dec422052e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:40.437937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533afd0-8819-42ef-8ec2-6dec422052e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:40.439018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533afd0-8819-42ef-8ec2-6dec422052e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:40.439329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533afd0-8819-42ef-8ec2-6dec422052e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:40.441064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533afd0-8819-42ef-8ec2-6dec422052e9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:40.457844 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 289/574] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:40.457844 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533afd0-8819-42ef-8ec2-6dec422052e9 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:40.464773 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09927d-f9ca-4342-87d4-2b91a454c5d1 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:40.501731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d32a1-8740-449a-87b5-940815916b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:40.502326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d32a1-8740-449a-87b5-940815916b16 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:40.502606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d32a1-8740-449a-87b5-940815916b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:40.502896 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d32a1-8740-449a-87b5-940815916b16 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:40.503657 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d32a1-8740-449a-87b5-940815916b16 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:40.503960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d32a1-8740-449a-87b5-940815916b16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:40.505376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d32a1-8740-449a-87b5-940815916b16 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:40.523087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 286/575] 10.222.0.25 () {56 vars in 1137 bytes} [Sat Sep 24 19:18:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:40.528013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d32a1-8740-449a-87b5-940815916b16 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:40.567758 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533afd0-8819-42ef-8ec2-6dec422052e9 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:40.600218 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:40.606409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd525a-0075-4216-8d3a-ea613c85839c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:40.607042 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd525a-0075-4216-8d3a-ea613c85839c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:40.607326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd525a-0075-4216-8d3a-ea613c85839c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:40.607602 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd525a-0075-4216-8d3a-ea613c85839c None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:40.608285 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd525a-0075-4216-8d3a-ea613c85839c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:40.608589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd525a-0075-4216-8d3a-ea613c85839c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:40.610011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd525a-0075-4216-8d3a-ea613c85839c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:40.621519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:40.623047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 290/576] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:18:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:40.624231 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd525a-0075-4216-8d3a-ea613c85839c None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:40.638545 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d32a1-8740-449a-87b5-940815916b16 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:40.671849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99c144-6eee-452b-a1bb-916869b84e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:40.672478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99c144-6eee-452b-a1bb-916869b84e83 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:40.672757 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99c144-6eee-452b-a1bb-916869b84e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:40.673029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99c144-6eee-452b-a1bb-916869b84e83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:40.683663 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99c144-6eee-452b-a1bb-916869b84e83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:40.688583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-7b99c144-6eee-452b-a1bb-916869b84e83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:40.688583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:40.688583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:40.688583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:40.688583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:40.688583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:40.688583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:40.688583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:40.688583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:40.688583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:40.688583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:40.688583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:40.688583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:40.688583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:40.688583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:40.688583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:40.689681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:40.689681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:40.689681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:40.689681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:40.689681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:40.689681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:40.689681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:40.689681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:40.689681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:40.689681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:40.689681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:40.689681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:40.689681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:40.689681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:40.689681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:40.689681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:40.691905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:40.691905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:40.691905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:40.691905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:40.691905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:40.691905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:40.691905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:40.691905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:40.691905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:40.691905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:40.691905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:40.691905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:40.691905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 287/577] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:18:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:40.691905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99c144-6eee-452b-a1bb-916869b84e83 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:40.730186 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd525a-0075-4216-8d3a-ea613c85839c None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:40.763134 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b13029-5371-4ca7-9583-30cc779ad478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:40.763691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b13029-5371-4ca7-9583-30cc779ad478 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:40.763969 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b13029-5371-4ca7-9583-30cc779ad478 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:40.764235 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b13029-5371-4ca7-9583-30cc779ad478 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:40.770663 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b13029-5371-4ca7-9583-30cc779ad478 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:40.772126 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b13029-5371-4ca7-9583-30cc779ad478 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:40.784122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-63b13029-5371-4ca7-9583-30cc779ad478 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:40.784122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:40.784122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:40.784122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:40.784122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:40.784122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:40.784122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:40.784122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:40.784122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:40.784122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:40.784122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:40.784122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:40.784122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:18:40.784122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:18:40.784122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:18:40.785214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:18:40.785214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:40.785214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:40.785214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:40.785214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:40.785214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:40.785214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:40.785214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:40.785214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:40.785214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:40.785214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:40.785214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:40.785214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:40.785214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:40.785214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:40.785214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:40.785214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:40.786105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:18:40.786105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:18:40.786105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:18:40.786105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:18:40.786105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:18:40.786105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:18:40.786105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:40.786105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:40.786105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 291/578] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:40.786105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b13029-5371-4ca7-9583-30cc779ad478 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:40.793196 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99c144-6eee-452b-a1bb-916869b84e83 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:40.828228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0ef8a-af97-4c6c-baae-d0ab77ae28b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:40.828847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0ef8a-af97-4c6c-baae-d0ab77ae28b2 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:40.829122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0ef8a-af97-4c6c-baae-d0ab77ae28b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:40.829386 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0ef8a-af97-4c6c-baae-d0ab77ae28b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:40.835297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:40.839661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0ef8a-af97-4c6c-baae-d0ab77ae28b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:40.841516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0ef8a-af97-4c6c-baae-d0ab77ae28b2 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:40.849836 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:40.856730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-6fb0ef8a-af97-4c6c-baae-d0ab77ae28b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:40.856730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:40.856730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:40.856730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:40.856730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:40.856730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:40.856730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:40.856730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:40.856730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:40.856730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:40.856730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:40.856730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:40.856730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:40.856730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:40.856730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:40.856730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:40.857838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:40.857838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:40.857838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:40.857838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:40.857838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:40.857838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:40.857838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:40.857838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:40.857838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:40.857838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:40.857838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:40.857838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:40.857838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:40.857838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:40.857838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:40.857838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:40.857838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:40.858790 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:40.858790 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:40.858790 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:40.858790 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 288/579] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:40.859043 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0ef8a-af97-4c6c-baae-d0ab77ae28b2 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:40.897075 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b13029-5371-4ca7-9583-30cc779ad478 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:40.931043 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8be97-f593-491e-9348-20b22b6470db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:40.932280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8be97-f593-491e-9348-20b22b6470db None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:40.932550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8be97-f593-491e-9348-20b22b6470db None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:40.932811 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8be97-f593-491e-9348-20b22b6470db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:40.942759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8be97-f593-491e-9348-20b22b6470db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:40.948890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-f2d8be97-f593-491e-9348-20b22b6470db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:40.948890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:40.948890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:40.948890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:40.948890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:40.948890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:40.948890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:40.948890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:40.948890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:40.948890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:40.948890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:40.948890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:40.948890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:40.948890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:40.948890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:40.948890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:40.949963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:40.949963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:40.949963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:40.949963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:40.949963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:40.949963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:40.949963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:40.949963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:40.949963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:40.949963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:40.949963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:40.949963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:40.949963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:40.949963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:40.949963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:40.949963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:40.951819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:40.951819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:40.951819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:40.951819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:40.951819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:40.951819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:40.951819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:40.951819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:40.951819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:40.951819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:40.951819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:40.951819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:40.951819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 292/580] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:18:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:40.951819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8be97-f593-491e-9348-20b22b6470db None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:40.959167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0ef8a-af97-4c6c-baae-d0ab77ae28b2 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:40.992779 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b04d6-d091-4734-b419-45fb80301843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:40.993383 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b04d6-d091-4734-b419-45fb80301843 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:40.993658 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b04d6-d091-4734-b419-45fb80301843 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:40.994493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b04d6-d091-4734-b419-45fb80301843 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:40.995242 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b04d6-d091-4734-b419-45fb80301843 None admin] RBAC: Adding query filter params (role.id=a2673fe5628247c3a918eaa28d483e9f, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=85b45de73f7b4f7da7e0e8d8375deb37) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:40.995551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b04d6-d091-4734-b419-45fb80301843 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:40.996965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b04d6-d091-4734-b419-45fb80301843 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:41.002428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 289/581] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:18:40 2022] GET /identity/v3/role_assignments?user.id=85b45de73f7b4f7da7e0e8d8375deb37&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=a2673fe5628247c3a918eaa28d483e9f => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:41.003129 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b04d6-d091-4734-b419-45fb80301843 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:41.073965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:41.074426 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8be97-f593-491e-9348-20b22b6470db None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:41.086571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:41.114668 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6577a59-6788-4892-aea4-e85f874577f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:41.115539 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6577a59-6788-4892-aea4-e85f874577f2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:41.115909 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6577a59-6788-4892-aea4-e85f874577f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:41.116251 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6577a59-6788-4892-aea4-e85f874577f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:41.116981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6577a59-6788-4892-aea4-e85f874577f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:41.117349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6577a59-6788-4892-aea4-e85f874577f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:41.118204 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b04d6-d091-4734-b419-45fb80301843 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:41.118993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6577a59-6788-4892-aea4-e85f874577f2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:41.129002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 293/582] 10.222.0.25 () {56 vars in 1103 bytes} [Sat Sep 24 19:18:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:41.130100 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6577a59-6788-4892-aea4-e85f874577f2 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:41.162799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ffc6a-cdff-4f79-8ae5-bd8e7067859b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:41.163452 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ffc6a-cdff-4f79-8ae5-bd8e7067859b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:41.163731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ffc6a-cdff-4f79-8ae5-bd8e7067859b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:41.164006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ffc6a-cdff-4f79-8ae5-bd8e7067859b None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:41.164707 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ffc6a-cdff-4f79-8ae5-bd8e7067859b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:41.165015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ffc6a-cdff-4f79-8ae5-bd8e7067859b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:41.167024 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ffc6a-cdff-4f79-8ae5-bd8e7067859b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:41.180972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 290/583] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:18:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:41.182791 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ffc6a-cdff-4f79-8ae5-bd8e7067859b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:41.250771 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6577a59-6788-4892-aea4-e85f874577f2 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:41.288996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc5529-5362-4747-819c-df5179bbe5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:41.289790 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc5529-5362-4747-819c-df5179bbe5f9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:41.290163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc5529-5362-4747-819c-df5179bbe5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:41.290434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ffc6a-cdff-4f79-8ae5-bd8e7067859b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:41.290611 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc5529-5362-4747-819c-df5179bbe5f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:41.291876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc5529-5362-4747-819c-df5179bbe5f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:41.292268 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc5529-5362-4747-819c-df5179bbe5f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:41.293720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc5529-5362-4747-819c-df5179bbe5f9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:41.305973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 294/584] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:41.307814 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc5529-5362-4747-819c-df5179bbe5f9 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:41.318550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:41.330265 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0b815-61e0-4e07-81a1-c291dacddbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:41.330967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0b815-61e0-4e07-81a1-c291dacddbd4 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:41.331343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0b815-61e0-4e07-81a1-c291dacddbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:41.331706 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0b815-61e0-4e07-81a1-c291dacddbd4 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:41.332454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0b815-61e0-4e07-81a1-c291dacddbd4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:41.332856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0b815-61e0-4e07-81a1-c291dacddbd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:41.334292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0b815-61e0-4e07-81a1-c291dacddbd4 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:41.342674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:41.347159 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 291/585] 10.222.0.25 () {56 vars in 1103 bytes} [Sat Sep 24 19:18:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:41.348026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0b815-61e0-4e07-81a1-c291dacddbd4 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:41.418214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc5529-5362-4747-819c-df5179bbe5f9 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:41.453116 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497ce31-4698-4a6a-b57d-3026b21c5624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:41.453794 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497ce31-4698-4a6a-b57d-3026b21c5624 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:41.454069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497ce31-4698-4a6a-b57d-3026b21c5624 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:41.454338 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497ce31-4698-4a6a-b57d-3026b21c5624 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:41.461191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0b815-61e0-4e07-81a1-c291dacddbd4 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:41.466284 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497ce31-4698-4a6a-b57d-3026b21c5624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:41.467824 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497ce31-4698-4a6a-b57d-3026b21c5624 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:41.490683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-6497ce31-4698-4a6a-b57d-3026b21c5624 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:41.490683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:41.490683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:41.490683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:41.490683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:41.490683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:41.490683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:41.490683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:41.490683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:41.490683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:41.490683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:41.490683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:41.490683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:41.490683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:41.490683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:41.490683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:41.491865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:41.491865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:41.491865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:41.491865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:41.491865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:41.491865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:41.491865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:41.491865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:41.491865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:41.491865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:41.491865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:41.491865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:41.491865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:41.491865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:41.491865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:41.491865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:41.491865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:41.493013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:41.493013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:41.493013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:41.497324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 295/586] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:41.498162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497ce31-4698-4a6a-b57d-3026b21c5624 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:41.498579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2da07-4e61-49db-9596-d954b928ac58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:41.499269 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2da07-4e61-49db-9596-d954b928ac58 None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:41.499548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2da07-4e61-49db-9596-d954b928ac58 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:41.499814 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2da07-4e61-49db-9596-d954b928ac58 None admin] PATH_INFO: `/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/4e5798be0fa544cf9cf48558e87fcfa9/roles/a2673fe5628247c3a918eaa28d483e9f` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:41.515898 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2da07-4e61-49db-9596-d954b928ac58 None admin] RBAC: Authorizing `identity:create_grant(project_id=f61085f09512451e92c9fa36fa9a8071, user_id=4e5798be0fa544cf9cf48558e87fcfa9, role_id=a2673fe5628247c3a918eaa28d483e9f)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:41.517720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2da07-4e61-49db-9596-d954b928ac58 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:41.531325 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 292/587] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:18:41 2022] PUT /identity/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/4e5798be0fa544cf9cf48558e87fcfa9/roles/a2673fe5628247c3a918eaa28d483e9f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:18:41.531906 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2da07-4e61-49db-9596-d954b928ac58 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:41.571949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:41.643833 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:41.650443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2da07-4e61-49db-9596-d954b928ac58 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:41.668741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497ce31-4698-4a6a-b57d-3026b21c5624 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:41.699434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362724de-0219-4295-9a52-3f9826484e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:41.701137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362724de-0219-4295-9a52-3f9826484e64 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:41.701613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362724de-0219-4295-9a52-3f9826484e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:41.702099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362724de-0219-4295-9a52-3f9826484e64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:41.708353 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f5f57-b0f2-461d-ad8a-8f31fb857b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:41.709115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f5f57-b0f2-461d-ad8a-8f31fb857b70 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:41.709504 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f5f57-b0f2-461d-ad8a-8f31fb857b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:41.709843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f5f57-b0f2-461d-ad8a-8f31fb857b70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:41.717910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362724de-0219-4295-9a52-3f9826484e64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:41.718095 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f5f57-b0f2-461d-ad8a-8f31fb857b70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:41.719435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f5f57-b0f2-461d-ad8a-8f31fb857b70 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:41.719990 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362724de-0219-4295-9a52-3f9826484e64 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:41.732049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-d13f5f57-b0f2-461d-ad8a-8f31fb857b70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:41.732049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:41.732049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:41.732049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:41.732049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:41.732049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:41.732049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:41.732049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:41.732049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:41.732049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:41.732049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:41.732049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:41.732049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:18:41.732049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:18:41.732049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:18:41.733163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:18:41.733163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:41.733163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:41.733163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:41.733163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:41.733163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:41.733163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:41.733163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:41.733163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:41.733163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:41.733163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:41.733163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:41.733163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:41.733163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:41.733163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:41.733163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:41.733163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:41.734314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:18:41.734314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:18:41.734314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:18:41.734314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:18:41.734314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:18:41.734314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:18:41.734314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:41.734314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:41.736748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 296/588] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:41.736967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f5f57-b0f2-461d-ad8a-8f31fb857b70 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:41.738818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-362724de-0219-4295-9a52-3f9826484e64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:41.738818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:41.738818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:41.738818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:41.738818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:41.738818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:41.738818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:41.738818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:41.738818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:41.738818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:41.738818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:41.738818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:41.738818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:41.738818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:41.738818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:41.738818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:41.740124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:41.740124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:41.740124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:41.740124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:41.740124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:41.740124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:41.740124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:41.740124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:41.740124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:41.740124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:41.740124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:41.740124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:41.740124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:41.740124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:41.740124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:41.740124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:41.740124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:41.741489 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:41.741489 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:41.741489 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:41.741489 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 293/589] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:41.745183 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362724de-0219-4295-9a52-3f9826484e64 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:41.857956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f5f57-b0f2-461d-ad8a-8f31fb857b70 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:41.863590 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:41.879738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362724de-0219-4295-9a52-3f9826484e64 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:41.902591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007ee78-f5c3-4a98-b1ac-c442d9009473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:41.903572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007ee78-f5c3-4a98-b1ac-c442d9009473 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:41.904040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007ee78-f5c3-4a98-b1ac-c442d9009473 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:41.904507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007ee78-f5c3-4a98-b1ac-c442d9009473 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:41.905305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007ee78-f5c3-4a98-b1ac-c442d9009473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:41.905749 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007ee78-f5c3-4a98-b1ac-c442d9009473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:41.907396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007ee78-f5c3-4a98-b1ac-c442d9009473 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:41.925877 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5139e-0691-428d-894b-adf828bfd3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:41.925877 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5139e-0691-428d-894b-adf828bfd3b0 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:41.925877 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5139e-0691-428d-894b-adf828bfd3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:41.925877 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5139e-0691-428d-894b-adf828bfd3b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:41.926321 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5139e-0691-428d-894b-adf828bfd3b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:41.926321 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5139e-0691-428d-894b-adf828bfd3b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:41.926321 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5139e-0691-428d-894b-adf828bfd3b0 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:41.926687 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 297/590] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:41.927823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007ee78-f5c3-4a98-b1ac-c442d9009473 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:41.932458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:41.945881 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 294/591] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:18:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:41.947049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5139e-0691-428d-894b-adf828bfd3b0 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:42.037442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007ee78-f5c3-4a98-b1ac-c442d9009473 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:42.055884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5139e-0691-428d-894b-adf828bfd3b0 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:42.075614 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384199a-0dc2-4212-8e1f-3a0e337b211a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:42.076268 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384199a-0dc2-4212-8e1f-3a0e337b211a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:42.076550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384199a-0dc2-4212-8e1f-3a0e337b211a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:42.076824 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384199a-0dc2-4212-8e1f-3a0e337b211a None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:42.077460 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384199a-0dc2-4212-8e1f-3a0e337b211a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:42.077812 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384199a-0dc2-4212-8e1f-3a0e337b211a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:42.079271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384199a-0dc2-4212-8e1f-3a0e337b211a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:42.092220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 298/592] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:42.093023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384199a-0dc2-4212-8e1f-3a0e337b211a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:42.098888 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df7306-f5bd-48a7-af7b-5a192446df26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:42.099714 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df7306-f5bd-48a7-af7b-5a192446df26 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:42.100135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df7306-f5bd-48a7-af7b-5a192446df26 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:42.100550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df7306-f5bd-48a7-af7b-5a192446df26 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:42.109102 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df7306-f5bd-48a7-af7b-5a192446df26 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:42.110856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df7306-f5bd-48a7-af7b-5a192446df26 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:42.123584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-60df7306-f5bd-48a7-af7b-5a192446df26 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 19:18:42.123584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:42.123584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:42.123584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:42.123584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:42.123584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:42.123584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:42.123584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:42.123584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:42.123584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:42.123584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:42.123584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:42.123584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:18:42.123584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:18:42.123584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:18:42.123584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:18:42.124721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:42.124721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:42.124721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:18:42.124721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:42.124721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:18:42.124721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:42.124721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:42.124721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:42.124721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:42.124721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:42.124721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:42.124721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:42.124721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:42.124721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:42.124721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:42.124721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:42.124721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:42.124721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:42.125726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:42.125726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:42.125726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:18:42.125726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:18:42.125726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:18:42.125726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:18:42.125726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:18:42.125726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:18:42.125726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 19:18:42.125726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:42.127813 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 295/593] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:18:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:42.128707 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df7306-f5bd-48a7-af7b-5a192446df26 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:42.140955 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:42.167370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:42.209619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384199a-0dc2-4212-8e1f-3a0e337b211a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:42.239784 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df7306-f5bd-48a7-af7b-5a192446df26 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:42.252794 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be0c57-dece-41a8-b6f5-d144073fa39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:42.254176 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be0c57-dece-41a8-b6f5-d144073fa39a None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:42.254746 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be0c57-dece-41a8-b6f5-d144073fa39a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:42.255207 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be0c57-dece-41a8-b6f5-d144073fa39a None admin] PATH_INFO: `/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/54232cb318b04e9286f58dae8b2a3fd4/roles/a2673fe5628247c3a918eaa28d483e9f` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:42.276653 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be0c57-dece-41a8-b6f5-d144073fa39a None admin] RBAC: Authorizing `identity:create_grant(project_id=f61085f09512451e92c9fa36fa9a8071, user_id=54232cb318b04e9286f58dae8b2a3fd4, role_id=a2673fe5628247c3a918eaa28d483e9f)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:42.278329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be0c57-dece-41a8-b6f5-d144073fa39a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:42.279125 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67849307-c816-4f2b-9ec0-aa07b9c808e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:42.279827 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67849307-c816-4f2b-9ec0-aa07b9c808e8 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:42.280170 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67849307-c816-4f2b-9ec0-aa07b9c808e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:42.280512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67849307-c816-4f2b-9ec0-aa07b9c808e8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:42.289557 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67849307-c816-4f2b-9ec0-aa07b9c808e8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:42.291377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67849307-c816-4f2b-9ec0-aa07b9c808e8 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:42.295816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 299/594] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:18:42 2022] PUT /identity/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/54232cb318b04e9286f58dae8b2a3fd4/roles/a2673fe5628247c3a918eaa28d483e9f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:18:42.296914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be0c57-dece-41a8-b6f5-d144073fa39a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:42.317741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-67849307-c816-4f2b-9ec0-aa07b9c808e8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:18:42.317741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:42.317741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:42.317741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:42.317741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:42.317741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:42.317741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:42.317741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:42.317741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:42.317741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:42.317741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:42.317741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:42.317741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:18:42.317741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:18:42.317741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:18:42.317741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:18:42.318972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:42.318972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:42.318972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:18:42.318972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:42.318972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:18:42.318972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:42.318972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:42.318972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:42.318972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:42.318972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:42.318972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:42.318972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:42.318972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:42.318972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:42.318972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:42.318972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:42.318972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:42.318972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:42.320021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:42.320021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:42.320021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:18:42.320021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:18:42.320021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:18:42.320021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:18:42.320021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:18:42.320021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:18:42.320021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:18:42.320021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:42.326439 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 296/595] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:42.330998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67849307-c816-4f2b-9ec0-aa07b9c808e8 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:42.507432 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:42.528272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be0c57-dece-41a8-b6f5-d144073fa39a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:42.547363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67849307-c816-4f2b-9ec0-aa07b9c808e8 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:42.548812 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:42.582310 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739beb3e-f543-4978-9ce1-722619ccfcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:42.583616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739beb3e-f543-4978-9ce1-722619ccfcd5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:42.584312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739beb3e-f543-4978-9ce1-722619ccfcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:42.584739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739beb3e-f543-4978-9ce1-722619ccfcd5 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:42.586276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739beb3e-f543-4978-9ce1-722619ccfcd5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:42.587374 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739beb3e-f543-4978-9ce1-722619ccfcd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:42.589159 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739beb3e-f543-4978-9ce1-722619ccfcd5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:42.591236 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cede4-2e26-498d-897b-3198457ad460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:42.592024 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cede4-2e26-498d-897b-3198457ad460 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:42.593042 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cede4-2e26-498d-897b-3198457ad460 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:42.593042 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cede4-2e26-498d-897b-3198457ad460 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:42.593621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cede4-2e26-498d-897b-3198457ad460 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:42.594014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cede4-2e26-498d-897b-3198457ad460 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:42.595568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cede4-2e26-498d-897b-3198457ad460 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:42.610678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 300/596] 10.222.0.25 () {56 vars in 1139 bytes} [Sat Sep 24 19:18:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:42.616993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739beb3e-f543-4978-9ce1-722619ccfcd5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:42.649329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 297/597] 10.222.0.25 () {56 vars in 1137 bytes} [Sat Sep 24 19:18:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:42.655813 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cede4-2e26-498d-897b-3198457ad460 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:42.726100 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739beb3e-f543-4978-9ce1-722619ccfcd5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:42.766119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7467d-b51a-49a7-9c81-f29e2b566fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:42.767310 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7467d-b51a-49a7-9c81-f29e2b566fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:42.767786 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7467d-b51a-49a7-9c81-f29e2b566fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:42.768201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7467d-b51a-49a7-9c81-f29e2b566fe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:42.780050 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7467d-b51a-49a7-9c81-f29e2b566fe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:42.781723 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7467d-b51a-49a7-9c81-f29e2b566fe0 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:42.800837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-21c7467d-b51a-49a7-9c81-f29e2b566fe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:42.800837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:42.800837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:42.800837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:42.800837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:42.800837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:42.800837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:42.800837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:42.800837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:42.800837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:42.800837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:42.800837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:42.800837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:42.800837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:42.800837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:42.800837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:42.802039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:42.802039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:42.802039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:42.802039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:42.802039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:42.802039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:42.802039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:42.802039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:42.802039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:42.802039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:42.802039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:42.802039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:42.802039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:42.802039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:42.802039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:42.802039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:42.802039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:42.803240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:42.803240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:42.803240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:42.804962 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 301/598] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:42.810561 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7467d-b51a-49a7-9c81-f29e2b566fe0 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:42.859247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:42.953027 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7467d-b51a-49a7-9c81-f29e2b566fe0 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:42.968052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cede4-2e26-498d-897b-3198457ad460 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:43.009819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:43.016078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6204d-e055-4c24-aaa4-8b58249813ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:43.016691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6204d-e055-4c24-aaa4-8b58249813ca None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:43.016967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6204d-e055-4c24-aaa4-8b58249813ca None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:43.017239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6204d-e055-4c24-aaa4-8b58249813ca None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:43.017873 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6204d-e055-4c24-aaa4-8b58249813ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:43.018179 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6204d-e055-4c24-aaa4-8b58249813ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:43.019562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6204d-e055-4c24-aaa4-8b58249813ca None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:43.033327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a1085-2d83-4844-981d-8945393d8b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:43.033964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a1085-2d83-4844-981d-8945393d8b7f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:43.034242 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a1085-2d83-4844-981d-8945393d8b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:43.034514 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a1085-2d83-4844-981d-8945393d8b7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:43.046324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 302/599] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:43.050032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a1085-2d83-4844-981d-8945393d8b7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:43.051527 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a1085-2d83-4844-981d-8945393d8b7f None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:43.052444 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6204d-e055-4c24-aaa4-8b58249813ca None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:43.080905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-8c9a1085-2d83-4844-981d-8945393d8b7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:43.080905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:43.080905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:43.080905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:43.080905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:43.080905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:43.080905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:43.080905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:43.080905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:43.080905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:43.080905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:43.080905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:43.080905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:43.080905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:43.080905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:43.080905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:43.082443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:43.082443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:43.082443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:43.082443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:43.082443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:43.082443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:43.082443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:43.082443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:43.082443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:43.082443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:43.082443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:43.082443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:43.082443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:43.082443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:43.082443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:43.082443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:43.082443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:43.083571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:43.083571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:43.083571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:43.083571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 298/600] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:43.091064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a1085-2d83-4844-981d-8945393d8b7f None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:43.218137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:43.230454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a1085-2d83-4844-981d-8945393d8b7f None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:43.257046 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6204d-e055-4c24-aaa4-8b58249813ca None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:43.274190 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c7c87-5c44-4391-9c3d-263691bb3fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:43.275491 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c7c87-5c44-4391-9c3d-263691bb3fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:43.276401 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c7c87-5c44-4391-9c3d-263691bb3fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:43.276826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c7c87-5c44-4391-9c3d-263691bb3fe5 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:43.277922 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c7c87-5c44-4391-9c3d-263691bb3fe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:43.278644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c7c87-5c44-4391-9c3d-263691bb3fe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:43.280660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c7c87-5c44-4391-9c3d-263691bb3fe5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:43.295786 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 299/601] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:43.297164 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e1548-fbdd-42f8-bd42-84f965561fdd None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:43.297526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e1548-fbdd-42f8-bd42-84f965561fdd None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:43.297871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e1548-fbdd-42f8-bd42-84f965561fdd None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:43.299411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 300/602] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:43.303575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855d234-0240-4d6e-b426-4cc6038dbdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:43.304378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855d234-0240-4d6e-b426-4cc6038dbdc9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:43.304659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855d234-0240-4d6e-b426-4cc6038dbdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:43.304919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855d234-0240-4d6e-b426-4cc6038dbdc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:43.308145 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2cca5-49c6-4cc4-a989-ed3a98cc6ff4 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:43.308613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2cca5-49c6-4cc4-a989-ed3a98cc6ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:43.309028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2cca5-49c6-4cc4-a989-ed3a98cc6ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:43.314233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855d234-0240-4d6e-b426-4cc6038dbdc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:43.315815 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855d234-0240-4d6e-b426-4cc6038dbdc9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:43.328039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-2855d234-0240-4d6e-b426-4cc6038dbdc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:43.328039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:43.328039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:43.328039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:43.328039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:43.328039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:43.328039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:43.328039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:43.328039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:43.328039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:43.328039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:43.328039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:43.328039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:18:43.328039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:18:43.328039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:18:43.329165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:18:43.329165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:43.329165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:43.329165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:43.329165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:43.329165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:43.329165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:43.329165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:43.329165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:43.329165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:43.329165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:43.329165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:43.329165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:43.329165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:43.329165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:43.329165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:43.329165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:43.330287 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:18:43.330287 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:18:43.330287 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:18:43.330287 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:18:43.330287 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:18:43.330287 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:18:43.330287 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:43.330287 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:43.331369 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-07e2cca5-49c6-4cc4-a989-ed3a98cc6ff4 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:43.331600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 303/603] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:18:43.332460 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855d234-0240-4d6e-b426-4cc6038dbdc9 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:43.333089 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-07e2cca5-49c6-4cc4-a989-ed3a98cc6ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:43.373769 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:43.446804 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 301/604] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:43.446804 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2cca5-49c6-4cc4-a989-ed3a98cc6ff4 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:43.481413 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855d234-0240-4d6e-b426-4cc6038dbdc9 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:43.529825 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821ad0d-c948-4e29-bf38-4dd898a8015d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:43.531371 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821ad0d-c948-4e29-bf38-4dd898a8015d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:43.532865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821ad0d-c948-4e29-bf38-4dd898a8015d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:43.533235 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821ad0d-c948-4e29-bf38-4dd898a8015d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:43.549931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821ad0d-c948-4e29-bf38-4dd898a8015d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:43.552688 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821ad0d-c948-4e29-bf38-4dd898a8015d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:43.574862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-2821ad0d-c948-4e29-bf38-4dd898a8015d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:43.574862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:43.574862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:43.574862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:43.574862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:43.574862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:43.574862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:43.574862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:43.574862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:43.574862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:43.574862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:43.574862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:43.574862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:18:43.574862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:18:43.574862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:18:43.576034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:18:43.576034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:43.576034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:43.576034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:43.576034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:43.576034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:43.576034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:43.576034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:43.576034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:43.576034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:43.576034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:43.576034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:43.576034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:43.576034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:43.576034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:43.576034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:43.576034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:43.577209 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:18:43.577209 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:18:43.577209 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:18:43.577209 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:18:43.577209 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:18:43.577209 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:18:43.577209 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:43.577209 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:43.579453 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 304/605] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:43.585178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821ad0d-c948-4e29-bf38-4dd898a8015d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:43.592476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:43.671047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2cca5-49c6-4cc4-a989-ed3a98cc6ff4 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:43.736367 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b5d27-9934-4af7-916b-fda64ba5f35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:43.737187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b5d27-9934-4af7-916b-fda64ba5f35c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:43.737464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b5d27-9934-4af7-916b-fda64ba5f35c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:43.737731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b5d27-9934-4af7-916b-fda64ba5f35c None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:43.738418 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b5d27-9934-4af7-916b-fda64ba5f35c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:43.738717 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b5d27-9934-4af7-916b-fda64ba5f35c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:43.741462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b5d27-9934-4af7-916b-fda64ba5f35c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:43.754710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821ad0d-c948-4e29-bf38-4dd898a8015d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:43.758742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 302/606] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:18:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:43.759729 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b5d27-9934-4af7-916b-fda64ba5f35c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:43.792336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:43.804537 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6744de-b185-4c2a-8234-2ea312cc809d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:43.806173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6744de-b185-4c2a-8234-2ea312cc809d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:43.807802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6744de-b185-4c2a-8234-2ea312cc809d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:43.808813 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6744de-b185-4c2a-8234-2ea312cc809d None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:43.810192 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6744de-b185-4c2a-8234-2ea312cc809d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:43.810738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6744de-b185-4c2a-8234-2ea312cc809d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:43.812498 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6744de-b185-4c2a-8234-2ea312cc809d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:43.829523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 305/607] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:18:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:43.830745 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6744de-b185-4c2a-8234-2ea312cc809d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:43.880250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b5d27-9934-4af7-916b-fda64ba5f35c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:43.921207 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51cb1a-96b9-4c0d-ae01-c654f4ae9dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:43.921930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51cb1a-96b9-4c0d-ae01-c654f4ae9dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:43.922286 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51cb1a-96b9-4c0d-ae01-c654f4ae9dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:43.922628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51cb1a-96b9-4c0d-ae01-c654f4ae9dc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:43.927167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:43.935173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51cb1a-96b9-4c0d-ae01-c654f4ae9dc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:43.940835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-4a51cb1a-96b9-4c0d-ae01-c654f4ae9dc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:43.940835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:43.940835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:43.940835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:43.940835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:43.940835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:43.940835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:43.940835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:43.940835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:43.940835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:43.940835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:43.940835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:43.940835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:43.940835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:43.940835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:43.940835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:43.942053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:43.942053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:43.942053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:43.942053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:43.942053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:43.942053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:43.942053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:43.942053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:43.942053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:43.942053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:43.942053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:43.942053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:43.942053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:43.942053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:43.942053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:43.942053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:43.943115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:43.943115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:43.943115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:43.943115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:43.943115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:43.943115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:43.943115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:43.943115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:43.943115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:43.943115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:43.943115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:43.943115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:43.944027 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 303/608] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:18:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:43.944859 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51cb1a-96b9-4c0d-ae01-c654f4ae9dc6 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:43.958167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6744de-b185-4c2a-8234-2ea312cc809d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:43.997838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54811e-35cc-41b5-b642-ac43812302fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:43.998491 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54811e-35cc-41b5-b642-ac43812302fc None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:43.998771 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54811e-35cc-41b5-b642-ac43812302fc None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:43.999073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54811e-35cc-41b5-b642-ac43812302fc None admin] PATH_INFO: `/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/1763ed41f99a4778b3df6eebcc6d94e8/roles/a2673fe5628247c3a918eaa28d483e9f` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:44.015082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54811e-35cc-41b5-b642-ac43812302fc None admin] RBAC: Authorizing `identity:create_grant(project_id=f61085f09512451e92c9fa36fa9a8071, user_id=1763ed41f99a4778b3df6eebcc6d94e8, role_id=a2673fe5628247c3a918eaa28d483e9f)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:44.016516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54811e-35cc-41b5-b642-ac43812302fc None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:44.030545 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 306/609] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:18:43 2022] PUT /identity/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/1763ed41f99a4778b3df6eebcc6d94e8/roles/a2673fe5628247c3a918eaa28d483e9f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:18:44.031785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18feaa8a-79b3-49d7-bced-34934d678c61 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:44.032068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18feaa8a-79b3-49d7-bced-34934d678c61 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:44.032337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18feaa8a-79b3-49d7-bced-34934d678c61 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:44.033703 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 307/610] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:44.034250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18feaa8a-79b3-49d7-bced-34934d678c61 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:44.054753 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:44.085576 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51cb1a-96b9-4c0d-ae01-c654f4ae9dc6 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:44.137329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a948a-e31a-4a59-b663-cf4ab28138ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:44.138073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a948a-e31a-4a59-b663-cf4ab28138ff None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:44.138351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a948a-e31a-4a59-b663-cf4ab28138ff None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:44.138689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a948a-e31a-4a59-b663-cf4ab28138ff None admin] PATH_INFO: `/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/5840a13ddf8c45f2bf97a4f6d4a48d96/roles/a2673fe5628247c3a918eaa28d483e9f` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:44.159766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a948a-e31a-4a59-b663-cf4ab28138ff None admin] RBAC: Authorizing `identity:create_grant(project_id=f61085f09512451e92c9fa36fa9a8071, user_id=5840a13ddf8c45f2bf97a4f6d4a48d96, role_id=a2673fe5628247c3a918eaa28d483e9f)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:44.162023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a948a-e31a-4a59-b663-cf4ab28138ff None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:44.175623 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18feaa8a-79b3-49d7-bced-34934d678c61 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:44.192518 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 304/611] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:18:43 2022] PUT /identity/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/5840a13ddf8c45f2bf97a4f6d4a48d96/roles/a2673fe5628247c3a918eaa28d483e9f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:18:44.192518 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f01817-73a1-4e7e-b06a-e6e8705aa3b6 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:44.192518 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f01817-73a1-4e7e-b06a-e6e8705aa3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:44.192518 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f01817-73a1-4e7e-b06a-e6e8705aa3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:44.209119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:44.223025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-b7f01817-73a1-4e7e-b06a-e6e8705aa3b6 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:44.224250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b7f01817-73a1-4e7e-b06a-e6e8705aa3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:44.243196 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c982664-99c0-4fbe-b3d4-5d75cef11fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:44.243852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c982664-99c0-4fbe-b3d4-5d75cef11fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:44.244127 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c982664-99c0-4fbe-b3d4-5d75cef11fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:44.244416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c982664-99c0-4fbe-b3d4-5d75cef11fd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:44.245052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c982664-99c0-4fbe-b3d4-5d75cef11fd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:44.245351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c982664-99c0-4fbe-b3d4-5d75cef11fd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:44.246734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c982664-99c0-4fbe-b3d4-5d75cef11fd8 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:44.255936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 308/612] 10.222.0.25 () {56 vars in 1103 bytes} [Sat Sep 24 19:18:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:44.262226 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c982664-99c0-4fbe-b3d4-5d75cef11fd8 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:44.319796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 305/613] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:44.402065 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c982664-99c0-4fbe-b3d4-5d75cef11fd8 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:44.459207 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538f8d3-7d5b-4ad9-98c2-1b6999209611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:44.460110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538f8d3-7d5b-4ad9-98c2-1b6999209611 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:44.460541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538f8d3-7d5b-4ad9-98c2-1b6999209611 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:44.460949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538f8d3-7d5b-4ad9-98c2-1b6999209611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:44.473170 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538f8d3-7d5b-4ad9-98c2-1b6999209611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:44.475056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538f8d3-7d5b-4ad9-98c2-1b6999209611 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:44.493884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-4538f8d3-7d5b-4ad9-98c2-1b6999209611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:44.493884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:44.493884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:44.493884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:44.493884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:44.493884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:44.493884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:44.493884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:44.493884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:44.493884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:44.493884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:44.493884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:44.493884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:44.493884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:44.493884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:44.493884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:44.495201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:44.495201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:44.495201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:44.495201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:44.495201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:44.495201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:44.495201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:44.495201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:44.495201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:44.495201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:44.495201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:44.495201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:44.495201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:44.495201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:44.495201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:44.495201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:44.495201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:44.496316 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:44.496316 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:44.496316 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:44.498006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 309/614] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:44.503441 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f01817-73a1-4e7e-b06a-e6e8705aa3b6 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:44.575352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:44.612163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f01817-73a1-4e7e-b06a-e6e8705aa3b6 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:44.649056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61fb7a-9219-443c-80b9-09f86176708a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:44.649663 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61fb7a-9219-443c-80b9-09f86176708a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:44.649937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61fb7a-9219-443c-80b9-09f86176708a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:44.650312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61fb7a-9219-443c-80b9-09f86176708a None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:44.651376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61fb7a-9219-443c-80b9-09f86176708a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:44.651679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61fb7a-9219-443c-80b9-09f86176708a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:44.653100 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61fb7a-9219-443c-80b9-09f86176708a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:44.665044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 306/615] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:44.671920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538f8d3-7d5b-4ad9-98c2-1b6999209611 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:44.708721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61fb7a-9219-443c-80b9-09f86176708a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:44.711289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:44.839259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61fb7a-9219-443c-80b9-09f86176708a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:44.872802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538f8d3-7d5b-4ad9-98c2-1b6999209611 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:44.873538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:44.883258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36bd46-0bef-4053-823a-92eb10913a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:44.884130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36bd46-0bef-4053-823a-92eb10913a01 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:44.884948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36bd46-0bef-4053-823a-92eb10913a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:44.885334 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36bd46-0bef-4053-823a-92eb10913a01 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:44.909168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36bd46-0bef-4053-823a-92eb10913a01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:44.915084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-af36bd46-0bef-4053-823a-92eb10913a01 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:44.915084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:44.915084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:44.915084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:44.915084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:44.915084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:44.915084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:44.915084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:44.915084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:44.915084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:44.915084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:44.915084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:44.915084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:44.915084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:44.915084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:44.915084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:44.916543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:44.916543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:44.916543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:44.916543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:44.916543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:44.916543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:44.916543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:44.916543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:44.916543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:44.916543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:44.916543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:44.916543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:44.916543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:44.916543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:44.916543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:44.916543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:44.917392 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:44.917392 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:44.917392 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:44.917392 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:44.917392 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:44.917392 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:44.917392 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:44.917392 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:44.917392 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:44.917392 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:44.917392 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:44.917392 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:44.918692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 307/616] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:18:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:18:44.918764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e0fb5-614c-4c4c-b8b5-c5b5b52f846c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:44.918764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e0fb5-614c-4c4c-b8b5-c5b5b52f846c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:44.918963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b89a42-1ed0-45c6-9273-52cba4a62fa3 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:44.919037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e0fb5-614c-4c4c-b8b5-c5b5b52f846c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:44.919107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b89a42-1ed0-45c6-9273-52cba4a62fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:44.919176 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e0fb5-614c-4c4c-b8b5-c5b5b52f846c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:44.919458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b89a42-1ed0-45c6-9273-52cba4a62fa3 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:44.920806 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 308/617] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:44.923458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b89a42-1ed0-45c6-9273-52cba4a62fa3 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:44.933134 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e0fb5-614c-4c4c-b8b5-c5b5b52f846c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:44.934850 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e0fb5-614c-4c4c-b8b5-c5b5b52f846c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:44.947764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-995e0fb5-614c-4c4c-b8b5-c5b5b52f846c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:18:44.947764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:44.947764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:44.947764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:44.947764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:44.947764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:44.947764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:44.947764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:44.947764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:44.947764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:44.947764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:44.947764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:44.947764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:18:44.947764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:18:44.947764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:18:44.947764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:18:44.948996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:44.948996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:44.948996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:18:44.948996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:44.948996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:18:44.948996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:44.948996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:44.948996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:44.948996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:44.948996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:44.948996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:44.948996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:44.948996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:44.948996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:44.948996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:44.948996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:44.948996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:44.948996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:44.949942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:44.949942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:44.949942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:18:44.949942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:18:44.949942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:18:44.949942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:18:44.949942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:18:44.949942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:18:44.949942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:18:44.949942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:44.949942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 310/618] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:18:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:44.950633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f3f00-93b3-4175-9504-299c4d859384 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:44.950633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f3f00-93b3-4175-9504-299c4d859384 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:44.951587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f3f00-93b3-4175-9504-299c4d859384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:44.972016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-622f3f00-93b3-4175-9504-299c4d859384 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:44.973360 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-622f3f00-93b3-4175-9504-299c4d859384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:45.051263 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 311/619] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:45.058602 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f3f00-93b3-4175-9504-299c4d859384 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:45.067659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b89a42-1ed0-45c6-9273-52cba4a62fa3 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:45.082012 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:45.160864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a9a46-7abb-4e1c-88d5-286ef3d6ec4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:45.161394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a9a46-7abb-4e1c-88d5-286ef3d6ec4a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:45.161623 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a9a46-7abb-4e1c-88d5-286ef3d6ec4a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:45.161791 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a9a46-7abb-4e1c-88d5-286ef3d6ec4a None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:45.162460 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a9a46-7abb-4e1c-88d5-286ef3d6ec4a None admin] RBAC: Adding query filter params (name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:45.162760 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a9a46-7abb-4e1c-88d5-286ef3d6ec4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:45.164262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a9a46-7abb-4e1c-88d5-286ef3d6ec4a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:45.173539 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 309/620] 10.222.0.25 () {56 vars in 1103 bytes} [Sat Sep 24 19:18:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:45.180035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a9a46-7abb-4e1c-88d5-286ef3d6ec4a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:45.197468 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f3f00-93b3-4175-9504-299c4d859384 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:45.267254 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:45.289605 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6070e1f-aa85-4dc3-a480-6fb2c13d0d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:45.290470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6070e1f-aa85-4dc3-a480-6fb2c13d0d66 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:45.290813 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6070e1f-aa85-4dc3-a480-6fb2c13d0d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:45.291110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6070e1f-aa85-4dc3-a480-6fb2c13d0d66 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:45.291837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6070e1f-aa85-4dc3-a480-6fb2c13d0d66 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:45.292144 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6070e1f-aa85-4dc3-a480-6fb2c13d0d66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:45.293561 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6070e1f-aa85-4dc3-a480-6fb2c13d0d66 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:45.331664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 312/621] 10.222.0.25 () {56 vars in 1135 bytes} [Sat Sep 24 19:18:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:45.336916 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6070e1f-aa85-4dc3-a480-6fb2c13d0d66 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:45.352084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a9a46-7abb-4e1c-88d5-286ef3d6ec4a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:45.390679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dddbb-0377-40b7-b6a6-2798a20d26f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:45.391414 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dddbb-0377-40b7-b6a6-2798a20d26f3 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:45.391659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dddbb-0377-40b7-b6a6-2798a20d26f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:45.391970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dddbb-0377-40b7-b6a6-2798a20d26f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:45.406806 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dddbb-0377-40b7-b6a6-2798a20d26f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:45.408647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dddbb-0377-40b7-b6a6-2798a20d26f3 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:45.424258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-c39dddbb-0377-40b7-b6a6-2798a20d26f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:45.424258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:45.424258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:45.424258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:45.424258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:45.424258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:45.424258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:45.424258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:45.424258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:45.424258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:45.424258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:45.424258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:45.424258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:45.424258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:45.424258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:45.424258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:45.425434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:45.425434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:45.425434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:45.425434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:45.425434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:45.425434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:45.425434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:45.425434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:45.425434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:45.425434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:45.425434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:45.425434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:45.425434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:45.425434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:45.425434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:45.425434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:45.425434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:45.426697 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:45.426697 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:45.426697 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:45.426697 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 310/622] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:45.426697 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dddbb-0377-40b7-b6a6-2798a20d26f3 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:45.427684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:45.455010 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6070e1f-aa85-4dc3-a480-6fb2c13d0d66 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:45.492866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96112e8a-985c-4b8e-af3e-582ca9bcfe78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:45.493498 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96112e8a-985c-4b8e-af3e-582ca9bcfe78 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:45.493889 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96112e8a-985c-4b8e-af3e-582ca9bcfe78 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:45.494231 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96112e8a-985c-4b8e-af3e-582ca9bcfe78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:45.505680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96112e8a-985c-4b8e-af3e-582ca9bcfe78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:45.507152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96112e8a-985c-4b8e-af3e-582ca9bcfe78 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:45.524142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-96112e8a-985c-4b8e-af3e-582ca9bcfe78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:45.524142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:45.524142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:45.524142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:45.524142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:45.524142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:45.524142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:45.524142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:45.524142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:45.524142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:45.524142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:45.524142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:45.524142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:45.524142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:45.524142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:45.524142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:45.525245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:45.525245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:45.525245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:45.525245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:45.525245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:45.525245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:45.525245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:45.525245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:45.525245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:45.525245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:45.525245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:45.525245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:45.525245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:45.525245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:45.525245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:45.525245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:45.525245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:45.526415 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:45.526415 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:45.526415 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:45.526415 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 313/623] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:45.526659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96112e8a-985c-4b8e-af3e-582ca9bcfe78 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:45.537683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dddbb-0377-40b7-b6a6-2798a20d26f3 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:45.539500 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:45.575361 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74a547-624d-4af7-8fd8-ec2ad4f4dc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:45.576246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a547-624d-4af7-8fd8-ec2ad4f4dc6c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:45.576697 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a547-624d-4af7-8fd8-ec2ad4f4dc6c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:45.577132 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a547-624d-4af7-8fd8-ec2ad4f4dc6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:45.588307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74a547-624d-4af7-8fd8-ec2ad4f4dc6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:45.594071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-1c74a547-624d-4af7-8fd8-ec2ad4f4dc6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:45.594071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:45.594071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:45.594071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:45.594071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:45.594071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:45.594071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:45.594071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:45.594071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:45.594071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:45.594071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:45.594071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:45.594071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:45.594071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:45.594071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:45.594071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:45.595108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:45.595108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:45.595108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:45.595108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:45.595108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:45.595108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:45.595108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:45.595108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:45.595108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:45.595108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:45.595108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:45.595108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:45.595108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:45.595108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:45.595108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:45.595108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:45.595947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:45.595947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:45.595947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:45.595947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:45.595947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:45.595947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:45.595947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:45.595947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:45.595947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:45.595947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:45.595947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:45.595947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:45.598595 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 311/624] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:18:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:45.599599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74a547-624d-4af7-8fd8-ec2ad4f4dc6c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:45.640470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96112e8a-985c-4b8e-af3e-582ca9bcfe78 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:45.668919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:45.678138 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09396e8-f530-4a38-8468-2b09c3bbeef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:45.678677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09396e8-f530-4a38-8468-2b09c3bbeef9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:45.679009 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09396e8-f530-4a38-8468-2b09c3bbeef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:45.679287 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09396e8-f530-4a38-8468-2b09c3bbeef9 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:45.679927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09396e8-f530-4a38-8468-2b09c3bbeef9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:45.680231 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09396e8-f530-4a38-8468-2b09c3bbeef9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:45.681729 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09396e8-f530-4a38-8468-2b09c3bbeef9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:45.694862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 314/625] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:45.695959 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09396e8-f530-4a38-8468-2b09c3bbeef9 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:45.722662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74a547-624d-4af7-8fd8-ec2ad4f4dc6c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:45.768518 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd2b37-3da9-4a27-9ff8-ed5eda4b75ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:45.769126 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd2b37-3da9-4a27-9ff8-ed5eda4b75ae None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:45.769404 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd2b37-3da9-4a27-9ff8-ed5eda4b75ae None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:45.769676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd2b37-3da9-4a27-9ff8-ed5eda4b75ae None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:45.770315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd2b37-3da9-4a27-9ff8-ed5eda4b75ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:45.770619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd2b37-3da9-4a27-9ff8-ed5eda4b75ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:45.772032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd2b37-3da9-4a27-9ff8-ed5eda4b75ae None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:45.786518 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 312/626] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:45.787448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd2b37-3da9-4a27-9ff8-ed5eda4b75ae None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:45.814435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:45.830239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09396e8-f530-4a38-8468-2b09c3bbeef9 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:45.866703 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829fffb-5e24-4391-9dd0-2a3653234e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:45.867337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829fffb-5e24-4391-9dd0-2a3653234e48 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:45.867615 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829fffb-5e24-4391-9dd0-2a3653234e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:45.867943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829fffb-5e24-4391-9dd0-2a3653234e48 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:45.868597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829fffb-5e24-4391-9dd0-2a3653234e48 None admin] RBAC: Adding query filter params (name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:45.869039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829fffb-5e24-4391-9dd0-2a3653234e48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:45.870405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829fffb-5e24-4391-9dd0-2a3653234e48 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:45.879248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 315/627] 10.222.0.25 () {56 vars in 1103 bytes} [Sat Sep 24 19:18:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:45.883908 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829fffb-5e24-4391-9dd0-2a3653234e48 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:45.914472 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd2b37-3da9-4a27-9ff8-ed5eda4b75ae None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:45.940552 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:45.964623 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414d166-4f3c-4063-ad80-4ffa043635d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:45.965615 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414d166-4f3c-4063-ad80-4ffa043635d9 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:45.966090 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414d166-4f3c-4063-ad80-4ffa043635d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:45.966556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414d166-4f3c-4063-ad80-4ffa043635d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:45.976478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414d166-4f3c-4063-ad80-4ffa043635d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:45.979308 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414d166-4f3c-4063-ad80-4ffa043635d9 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:45.996999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-e414d166-4f3c-4063-ad80-4ffa043635d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:18:45.996999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:45.996999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:45.996999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:45.996999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:45.996999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:45.996999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:45.996999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:45.996999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:45.996999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:45.996999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:45.996999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:45.996999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:18:45.996999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:18:45.996999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:18:45.996999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:18:45.998047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:45.998047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:45.998047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:18:45.998047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:45.998047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:18:45.998047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:45.998047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:45.998047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:45.998047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:45.998047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:45.998047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:45.998047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:45.998047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:45.998047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:45.998047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:45.998047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:45.998047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:45.998047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:45.999020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:45.999020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:45.999020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:18:45.999020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:18:45.999020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:18:45.999020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:18:45.999020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:18:45.999020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:18:45.999020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:18:45.999020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:45.999564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829fffb-5e24-4391-9dd0-2a3653234e48 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:46.002679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 313/628] 10.222.0.25 () {56 vars in 1093 bytes} [Sat Sep 24 19:18:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:46.003687 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414d166-4f3c-4063-ad80-4ffa043635d9 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:46.047369 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa634c19-8672-4255-b75e-41d6a3796184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:46.048426 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa634c19-8672-4255-b75e-41d6a3796184 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:46.048910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa634c19-8672-4255-b75e-41d6a3796184 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:46.049388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa634c19-8672-4255-b75e-41d6a3796184 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:46.059954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa634c19-8672-4255-b75e-41d6a3796184 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:46.062339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa634c19-8672-4255-b75e-41d6a3796184 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:46.078220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-aa634c19-8672-4255-b75e-41d6a3796184 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:46.078220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:46.078220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:46.078220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:46.078220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:46.078220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:46.078220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:46.078220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:46.078220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:46.078220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:46.078220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:46.078220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:46.078220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:18:46.078220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:18:46.078220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:18:46.079182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:18:46.079182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:46.079182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:46.079182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:46.079182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:46.079182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:46.079182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:46.079182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:46.079182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:46.079182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:46.079182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:46.079182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:46.079182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:46.079182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:46.079182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:46.079182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:46.079182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:46.080086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:18:46.080086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:18:46.080086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:18:46.080086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:18:46.080086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:18:46.080086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:18:46.080086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:46.080086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:46.080514 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 316/629] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:46.081535 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa634c19-8672-4255-b75e-41d6a3796184 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:46.103007 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:46.136435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414d166-4f3c-4063-ad80-4ffa043635d9 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:46.184476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ab893-9dd8-4239-8b3e-6805b3c7a81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:46.186500 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ab893-9dd8-4239-8b3e-6805b3c7a81a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:46.187097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ab893-9dd8-4239-8b3e-6805b3c7a81a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:46.187643 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ab893-9dd8-4239-8b3e-6805b3c7a81a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:46.192245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa634c19-8672-4255-b75e-41d6a3796184 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:46.203169 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ab893-9dd8-4239-8b3e-6805b3c7a81a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:46.205732 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:46.207096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ab893-9dd8-4239-8b3e-6805b3c7a81a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:46.229680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-b35ab893-9dd8-4239-8b3e-6805b3c7a81a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:46.229680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:46.229680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:46.229680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:46.229680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:46.229680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:46.229680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:46.229680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:46.229680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:46.229680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:46.229680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:46.229680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:46.229680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:46.229680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:46.229680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:46.229680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:46.230944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:46.230944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:46.230944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:46.230944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:46.230944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:46.230944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:46.230944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:46.230944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:46.230944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:46.230944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:46.230944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:46.230944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:46.230944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:46.230944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:46.230944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:46.230944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:46.230944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:46.231853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:46.231853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:46.231853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:46.236655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 314/630] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:46.236655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ab893-9dd8-4239-8b3e-6805b3c7a81a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:46.236866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6452c-0b7b-40b1-a3c4-8cda797dd8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:46.236866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6452c-0b7b-40b1-a3c4-8cda797dd8df None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:46.236866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6452c-0b7b-40b1-a3c4-8cda797dd8df None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:46.236866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6452c-0b7b-40b1-a3c4-8cda797dd8df None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:46.239594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6452c-0b7b-40b1-a3c4-8cda797dd8df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:46.240154 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6452c-0b7b-40b1-a3c4-8cda797dd8df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:46.242796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6452c-0b7b-40b1-a3c4-8cda797dd8df None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:46.270764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 317/631] 10.222.0.25 () {56 vars in 1133 bytes} [Sat Sep 24 19:18:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:46.272331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6452c-0b7b-40b1-a3c4-8cda797dd8df None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:46.370788 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ab893-9dd8-4239-8b3e-6805b3c7a81a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:46.381422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6452c-0b7b-40b1-a3c4-8cda797dd8df None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:46.416997 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c0d79-5619-44e0-bbd0-b0f354911d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:46.417916 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c0d79-5619-44e0-bbd0-b0f354911d31 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:46.419535 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c0d79-5619-44e0-bbd0-b0f354911d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:46.420005 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c0d79-5619-44e0-bbd0-b0f354911d31 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:46.421144 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c0d79-5619-44e0-bbd0-b0f354911d31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:46.421960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c0d79-5619-44e0-bbd0-b0f354911d31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:46.424346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c0d79-5619-44e0-bbd0-b0f354911d31 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:46.427189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:46.431490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b4616-47a7-4ffb-9fdb-829247251028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:46.432204 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b4616-47a7-4ffb-9fdb-829247251028 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:46.432579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b4616-47a7-4ffb-9fdb-829247251028 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:46.432977 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b4616-47a7-4ffb-9fdb-829247251028 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:46.433728 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b4616-47a7-4ffb-9fdb-829247251028 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:46.434123 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b4616-47a7-4ffb-9fdb-829247251028 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:46.435633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b4616-47a7-4ffb-9fdb-829247251028 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:46.442947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 315/632] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:18:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:46.444093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c0d79-5619-44e0-bbd0-b0f354911d31 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:46.457810 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 318/633] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:46.457810 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b4616-47a7-4ffb-9fdb-829247251028 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:46.488720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:46.566730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b4616-47a7-4ffb-9fdb-829247251028 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:46.597121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c0d79-5619-44e0-bbd0-b0f354911d31 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:46.607579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859089ff-a89f-4eef-8ee7-d991f353e257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:46.608239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859089ff-a89f-4eef-8ee7-d991f353e257 None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:46.608519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859089ff-a89f-4eef-8ee7-d991f353e257 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:46.608794 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859089ff-a89f-4eef-8ee7-d991f353e257 None admin] PATH_INFO: `/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/85b45de73f7b4f7da7e0e8d8375deb37/roles/a2673fe5628247c3a918eaa28d483e9f` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:46.623924 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859089ff-a89f-4eef-8ee7-d991f353e257 None admin] RBAC: Authorizing `identity:create_grant(project_id=f61085f09512451e92c9fa36fa9a8071, user_id=85b45de73f7b4f7da7e0e8d8375deb37, role_id=a2673fe5628247c3a918eaa28d483e9f)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:46.625351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859089ff-a89f-4eef-8ee7-d991f353e257 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:46.634081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc372d-7592-48a3-9b3d-0a987e53348c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:46.636293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc372d-7592-48a3-9b3d-0a987e53348c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:46.636706 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc372d-7592-48a3-9b3d-0a987e53348c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:46.637104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc372d-7592-48a3-9b3d-0a987e53348c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:46.648153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 319/634] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:18:46 2022] PUT /identity/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/85b45de73f7b4f7da7e0e8d8375deb37/roles/a2673fe5628247c3a918eaa28d483e9f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:18:46.648153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859089ff-a89f-4eef-8ee7-d991f353e257 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:46.747983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:46.758485 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc372d-7592-48a3-9b3d-0a987e53348c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:46.760751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc372d-7592-48a3-9b3d-0a987e53348c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:46.761769 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:46.792588 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859089ff-a89f-4eef-8ee7-d991f353e257 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:46.835936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c83cca-81a2-4207-8666-7d08b9838058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:46.836575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c83cca-81a2-4207-8666-7d08b9838058 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:46.836852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c83cca-81a2-4207-8666-7d08b9838058 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:46.837125 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c83cca-81a2-4207-8666-7d08b9838058 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:46.844951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c83cca-81a2-4207-8666-7d08b9838058 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:46.846378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c83cca-81a2-4207-8666-7d08b9838058 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:46.858695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-74c83cca-81a2-4207-8666-7d08b9838058 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 24 19:18:46.858695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:46.858695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:46.858695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:46.858695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:46.858695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:46.858695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:46.858695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:46.858695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:46.858695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:46.858695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:46.858695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:46.858695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:18:46.858695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:18:46.858695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:18:46.858695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:18:46.859853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:46.859853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:46.859853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:18:46.859853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:46.859853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:18:46.859853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:46.859853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:46.859853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:46.859853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:46.859853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:46.859853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:46.859853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:46.859853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:46.859853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:46.859853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:46.859853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:46.859853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:46.859853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:46.860807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:46.860807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:46.860807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:18:46.860807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:18:46.860807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:18:46.860807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:18:46.860807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:18:46.860807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:18:46.860807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 24 19:18:46.860807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:46.860807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 320/635] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:46.861403 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85745219-311c-42bf-9b6d-1a729fad7024 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:46.861403 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85745219-311c-42bf-9b6d-1a729fad7024 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:46.861925 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85745219-311c-42bf-9b6d-1a729fad7024 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:46.866883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 321/636] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:46.866883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e594b-2c3c-44db-8a16-9ca365944804 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:46.866883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e594b-2c3c-44db-8a16-9ca365944804 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:46.866883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e594b-2c3c-44db-8a16-9ca365944804 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:46.866883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 322/637] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:46.867272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e594b-2c3c-44db-8a16-9ca365944804 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:46.880559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 316/638] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:18:46.881810 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd3aff-a516-4bdf-946f-de334314cc6d None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:46.882088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd3aff-a516-4bdf-946f-de334314cc6d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:46.882355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd3aff-a516-4bdf-946f-de334314cc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:46.902032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-f7fd3aff-a516-4bdf-946f-de334314cc6d None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:46.903245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f7fd3aff-a516-4bdf-946f-de334314cc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:46.973911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 317/639] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:46.975187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9acee-e0c8-4d70-ab4a-5e105af1110a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:46.975465 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9acee-e0c8-4d70-ab4a-5e105af1110a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:46.975729 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9acee-e0c8-4d70-ab4a-5e105af1110a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:46.983901 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e594b-2c3c-44db-8a16-9ca365944804 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:47.000860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-aaa9acee-e0c8-4d70-ab4a-5e105af1110a None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:47.002256 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-aaa9acee-e0c8-4d70-ab4a-5e105af1110a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:47.021092 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:47.031261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e8ac6-ac13-4692-adfa-d7509585c562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:47.032060 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e8ac6-ac13-4692-adfa-d7509585c562 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:47.032409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e8ac6-ac13-4692-adfa-d7509585c562 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:47.032746 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e8ac6-ac13-4692-adfa-d7509585c562 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:47.033535 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e8ac6-ac13-4692-adfa-d7509585c562 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:47.033944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e8ac6-ac13-4692-adfa-d7509585c562 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:47.036101 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e8ac6-ac13-4692-adfa-d7509585c562 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:47.046015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:47.059604 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 323/640] 10.222.0.25 () {56 vars in 1137 bytes} [Sat Sep 24 19:18:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:47.060705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e8ac6-ac13-4692-adfa-d7509585c562 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:47.085280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 318/641] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:47.087964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9acee-e0c8-4d70-ab4a-5e105af1110a None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:47.200343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e8ac6-ac13-4692-adfa-d7509585c562 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:47.241421 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30605b-76cd-4fc4-b2fd-99ca9ccd4434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:47.242283 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30605b-76cd-4fc4-b2fd-99ca9ccd4434 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:47.242556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30605b-76cd-4fc4-b2fd-99ca9ccd4434 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:47.242822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30605b-76cd-4fc4-b2fd-99ca9ccd4434 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:47.248118 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9acee-e0c8-4d70-ab4a-5e105af1110a None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:47.255910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30605b-76cd-4fc4-b2fd-99ca9ccd4434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:47.257333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30605b-76cd-4fc4-b2fd-99ca9ccd4434 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:47.274509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-3b30605b-76cd-4fc4-b2fd-99ca9ccd4434 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:47.274509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:47.274509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:47.274509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:47.274509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:47.274509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:47.274509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:47.274509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:47.274509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:47.274509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:47.274509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:47.274509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:47.274509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:47.274509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:47.274509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:47.274509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:47.275866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:47.275866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:47.275866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:47.275866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:47.275866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:47.275866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:47.275866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:47.275866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:47.275866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:47.275866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:47.275866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:47.275866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:47.275866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:47.275866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:47.275866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:47.275866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:47.275866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:47.277380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:47.277380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:47.277380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:47.277380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 324/642] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:47.282039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30605b-76cd-4fc4-b2fd-99ca9ccd4434 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:47.310793 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28a2d6-5e80-4afb-9f0b-d7885e20d63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:47.311437 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28a2d6-5e80-4afb-9f0b-d7885e20d63f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:47.311716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28a2d6-5e80-4afb-9f0b-d7885e20d63f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:47.311988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28a2d6-5e80-4afb-9f0b-d7885e20d63f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:47.338058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:47.345220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:47.387455 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28a2d6-5e80-4afb-9f0b-d7885e20d63f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:47.389012 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28a2d6-5e80-4afb-9f0b-d7885e20d63f None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:47.410814 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30605b-76cd-4fc4-b2fd-99ca9ccd4434 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:47.451689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c0508-ddc8-4ff1-aa39-60fb1f5a3d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:47.452693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c0508-ddc8-4ff1-aa39-60fb1f5a3d23 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:47.453044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c0508-ddc8-4ff1-aa39-60fb1f5a3d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:47.453390 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c0508-ddc8-4ff1-aa39-60fb1f5a3d23 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:47.454109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c0508-ddc8-4ff1-aa39-60fb1f5a3d23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:47.454479 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c0508-ddc8-4ff1-aa39-60fb1f5a3d23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:47.455946 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c0508-ddc8-4ff1-aa39-60fb1f5a3d23 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:47.473225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 325/643] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:47.473225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c0508-ddc8-4ff1-aa39-60fb1f5a3d23 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:47.508352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 319/644] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:18:47.508352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28a2d6-5e80-4afb-9f0b-d7885e20d63f None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:47.568375 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:47.582070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c0508-ddc8-4ff1-aa39-60fb1f5a3d23 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:47.592352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:47.617267 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28a2d6-5e80-4afb-9f0b-d7885e20d63f None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:47.619414 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be77aa1-a4c0-4da3-bac1-e1065dae9e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:47.620149 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be77aa1-a4c0-4da3-bac1-e1065dae9e32 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:47.620530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be77aa1-a4c0-4da3-bac1-e1065dae9e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:47.620907 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be77aa1-a4c0-4da3-bac1-e1065dae9e32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:47.633189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be77aa1-a4c0-4da3-bac1-e1065dae9e32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:47.638783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-3be77aa1-a4c0-4da3-bac1-e1065dae9e32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:47.638783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:47.638783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:47.638783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:47.638783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:47.638783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:47.638783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:47.638783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:47.638783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:47.638783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:47.638783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:47.638783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:47.638783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:47.638783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:47.638783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:47.638783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:47.639998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:47.639998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:47.639998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:47.639998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:47.639998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:47.639998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:47.639998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:47.639998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:47.639998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:47.639998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:47.639998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:47.639998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:47.639998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:47.639998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:47.639998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:47.639998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:47.641059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:47.641059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:47.641059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:47.641059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:47.641059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:47.641059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:47.641059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:47.641059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:47.641059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:47.641059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:47.641059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:47.641059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:47.642369 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 326/645] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:18:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:47.643265 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be77aa1-a4c0-4da3-bac1-e1065dae9e32 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:47.661131 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f2653-0cf7-4f00-b08a-adc1f14f4b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:47.661762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f2653-0cf7-4f00-b08a-adc1f14f4b03 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:47.662035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f2653-0cf7-4f00-b08a-adc1f14f4b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:47.662303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f2653-0cf7-4f00-b08a-adc1f14f4b03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:47.672743 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f2653-0cf7-4f00-b08a-adc1f14f4b03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:47.677480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-be6f2653-0cf7-4f00-b08a-adc1f14f4b03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:47.677480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:47.677480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:47.677480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:47.677480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:47.677480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:47.677480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:47.677480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:47.677480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:47.677480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:47.677480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:47.677480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:47.677480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:47.677480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:47.677480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:47.677480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:47.678417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:47.678417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:47.678417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:47.678417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:47.678417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:47.678417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:47.678417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:47.678417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:47.678417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:47.678417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:47.678417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:47.678417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:47.678417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:47.678417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:47.678417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:47.678417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:47.679467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:47.679467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:47.679467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:47.679467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:47.679467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:47.679467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:47.679467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:47.679467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:47.679467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:47.679467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:47.679467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:47.679467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:47.679467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 320/646] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:18:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:47.679467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f2653-0cf7-4f00-b08a-adc1f14f4b03 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:47.751738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be77aa1-a4c0-4da3-bac1-e1065dae9e32 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:47.782084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f2653-0cf7-4f00-b08a-adc1f14f4b03 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:47.785309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0187daa-d642-4914-a344-2def253c380f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:47.785944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0187daa-d642-4914-a344-2def253c380f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:47.786228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0187daa-d642-4914-a344-2def253c380f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:47.786502 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0187daa-d642-4914-a344-2def253c380f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:47.794456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0187daa-d642-4914-a344-2def253c380f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:47.796001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0187daa-d642-4914-a344-2def253c380f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:47.796664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:47.808320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-f0187daa-d642-4914-a344-2def253c380f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:47.808320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:47.808320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:47.808320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:47.808320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:47.808320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:47.808320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:47.808320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:47.808320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:47.808320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:47.808320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:47.808320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:47.808320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:18:47.808320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:18:47.808320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:18:47.809227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:18:47.809227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:47.809227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:47.809227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:47.809227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:47.809227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:47.809227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:47.809227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:47.809227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:47.809227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:47.809227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:47.809227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:47.809227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:47.809227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:47.809227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:47.809227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:47.809227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:47.810141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:18:47.810141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:18:47.810141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:18:47.810141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:18:47.810141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:18:47.810141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:18:47.810141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:47.810141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:47.810141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 327/647] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:47.810141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0187daa-d642-4914-a344-2def253c380f None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:47.822958 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c59f07-4ff8-461b-ad84-244941a839f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:47.823592 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c59f07-4ff8-461b-ad84-244941a839f7 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:47.823870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c59f07-4ff8-461b-ad84-244941a839f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:47.824137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c59f07-4ff8-461b-ad84-244941a839f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:47.834322 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c59f07-4ff8-461b-ad84-244941a839f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:47.835799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c59f07-4ff8-461b-ad84-244941a839f7 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:47.843004 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:47.852003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-00c59f07-4ff8-461b-ad84-244941a839f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:47.852003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:47.852003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:47.852003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:47.852003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:47.852003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:47.852003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:47.852003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:47.852003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:47.852003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:47.852003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:47.852003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:47.852003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:47.852003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:47.852003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:47.852003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:47.852933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:47.852933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:47.852933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:47.852933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:47.852933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:47.852933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:47.852933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:47.852933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:47.852933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:47.852933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:47.852933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:47.852933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:47.852933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:47.852933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:47.852933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:47.852933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:47.852933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:47.859091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:47.859091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:47.859091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:47.859091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 321/648] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:47.859091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c59f07-4ff8-461b-ad84-244941a839f7 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:47.923930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0187daa-d642-4914-a344-2def253c380f None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:47.960824 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671ef6a-1e24-46f0-9a37-f922b2bff414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:47.961712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671ef6a-1e24-46f0-9a37-f922b2bff414 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:47.961992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671ef6a-1e24-46f0-9a37-f922b2bff414 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:47.962266 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671ef6a-1e24-46f0-9a37-f922b2bff414 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:47.963023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671ef6a-1e24-46f0-9a37-f922b2bff414 None admin] RBAC: Adding query filter params (name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:47.963321 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671ef6a-1e24-46f0-9a37-f922b2bff414 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:47.963729 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c59f07-4ff8-461b-ad84-244941a839f7 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:47.964704 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671ef6a-1e24-46f0-9a37-f922b2bff414 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:47.973309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 328/649] 10.222.0.25 () {56 vars in 1103 bytes} [Sat Sep 24 19:18:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:47.974354 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671ef6a-1e24-46f0-9a37-f922b2bff414 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:48.004152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec4204-ca87-40a7-b08c-a18e4dc56254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:48.004760 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec4204-ca87-40a7-b08c-a18e4dc56254 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:48.005044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec4204-ca87-40a7-b08c-a18e4dc56254 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:48.005317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec4204-ca87-40a7-b08c-a18e4dc56254 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:48.005975 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec4204-ca87-40a7-b08c-a18e4dc56254 None admin] RBAC: Adding query filter params (name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:48.006280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec4204-ca87-40a7-b08c-a18e4dc56254 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:48.007735 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec4204-ca87-40a7-b08c-a18e4dc56254 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:48.021599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 322/650] 10.222.0.25 () {56 vars in 1103 bytes} [Sat Sep 24 19:18:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:48.022474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec4204-ca87-40a7-b08c-a18e4dc56254 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:48.053910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:48.071364 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:48.082874 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671ef6a-1e24-46f0-9a37-f922b2bff414 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:48.118210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f39d2-4e06-4160-9865-9e889c020efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:48.118966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f39d2-4e06-4160-9865-9e889c020efb None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:48.119243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f39d2-4e06-4160-9865-9e889c020efb None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:48.119598 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f39d2-4e06-4160-9865-9e889c020efb None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:48.120381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f39d2-4e06-4160-9865-9e889c020efb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:48.120687 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f39d2-4e06-4160-9865-9e889c020efb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:48.122114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f39d2-4e06-4160-9865-9e889c020efb None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:48.134051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec4204-ca87-40a7-b08c-a18e4dc56254 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:48.139869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 329/651] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:18:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:48.139869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f39d2-4e06-4160-9865-9e889c020efb None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:48.169066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1378d4-728b-4f02-90a6-a9bd8c30a811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:48.169665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1378d4-728b-4f02-90a6-a9bd8c30a811 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:48.169940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1378d4-728b-4f02-90a6-a9bd8c30a811 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:48.170204 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1378d4-728b-4f02-90a6-a9bd8c30a811 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:48.170846 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1378d4-728b-4f02-90a6-a9bd8c30a811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:48.171154 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1378d4-728b-4f02-90a6-a9bd8c30a811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:48.172497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1378d4-728b-4f02-90a6-a9bd8c30a811 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:48.186466 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 323/652] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:48.187589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1378d4-728b-4f02-90a6-a9bd8c30a811 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:48.245651 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f39d2-4e06-4160-9865-9e889c020efb None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:48.280308 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:48.281966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a7289-3f42-4896-a910-916ca28dbf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:48.282620 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a7289-3f42-4896-a910-916ca28dbf3e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:48.283024 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a7289-3f42-4896-a910-916ca28dbf3e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:48.283687 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a7289-3f42-4896-a910-916ca28dbf3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:48.294383 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1378d4-728b-4f02-90a6-a9bd8c30a811 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:48.294733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a7289-3f42-4896-a910-916ca28dbf3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:48.296302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a7289-3f42-4896-a910-916ca28dbf3e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:48.312078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-832a7289-3f42-4896-a910-916ca28dbf3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:48.312078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:48.312078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:48.312078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:48.312078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:48.312078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:48.312078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:48.312078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:48.312078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:48.312078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:48.312078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:48.312078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:48.312078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:48.312078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:48.312078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:48.312078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:48.313022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:48.313022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:48.313022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:48.313022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:48.313022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:48.313022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:48.313022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:48.313022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:48.313022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:48.313022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:48.313022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:48.313022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:48.313022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:48.313022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:48.313022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:48.313022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:48.313022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:48.314013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:48.314013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:48.314013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:48.314013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 330/653] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:48.314238 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a7289-3f42-4896-a910-916ca28dbf3e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:48.316952 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:48.339536 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbec1b9-5e9c-41aa-8270-0965491c9b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:48.340309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbec1b9-5e9c-41aa-8270-0965491c9b60 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:48.340595 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbec1b9-5e9c-41aa-8270-0965491c9b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:48.340845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbec1b9-5e9c-41aa-8270-0965491c9b60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:48.350970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbec1b9-5e9c-41aa-8270-0965491c9b60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:48.352388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbec1b9-5e9c-41aa-8270-0965491c9b60 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:48.368070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-dcbec1b9-5e9c-41aa-8270-0965491c9b60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:48.368070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:48.368070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:48.368070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:48.368070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:48.368070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:48.368070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:48.368070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:48.368070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:48.368070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:48.368070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:48.368070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:48.368070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:48.368070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:48.368070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:48.368070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:48.369601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:48.369601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:48.369601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:48.369601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:48.369601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:48.369601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:48.369601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:48.369601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:48.369601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:48.369601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:48.369601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:48.369601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:48.369601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:48.369601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:48.369601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:48.369601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:48.369601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:48.370534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:48.370534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:48.370534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:48.370534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 324/654] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:48.371548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbec1b9-5e9c-41aa-8270-0965491c9b60 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:48.438863 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a7289-3f42-4896-a910-916ca28dbf3e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:48.476801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774761d-3288-495d-899f-a1b3d56e2522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:48.477136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbec1b9-5e9c-41aa-8270-0965491c9b60 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:48.477407 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774761d-3288-495d-899f-a1b3d56e2522 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:48.477685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774761d-3288-495d-899f-a1b3d56e2522 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:48.477982 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774761d-3288-495d-899f-a1b3d56e2522 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:48.479403 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774761d-3288-495d-899f-a1b3d56e2522 None admin] RBAC: Adding query filter params (role.id=a2673fe5628247c3a918eaa28d483e9f, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=4e5798be0fa544cf9cf48558e87fcfa9) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:48.479710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774761d-3288-495d-899f-a1b3d56e2522 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:48.481160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774761d-3288-495d-899f-a1b3d56e2522 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:48.487332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 331/655] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:18:48 2022] GET /identity/v3/role_assignments?user.id=4e5798be0fa544cf9cf48558e87fcfa9&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=a2673fe5628247c3a918eaa28d483e9f => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:48.496257 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774761d-3288-495d-899f-a1b3d56e2522 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:48.517593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d2e19-85dd-4a02-8f4c-96cedb1e0705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:48.518397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d2e19-85dd-4a02-8f4c-96cedb1e0705 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:48.518762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d2e19-85dd-4a02-8f4c-96cedb1e0705 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:48.519178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d2e19-85dd-4a02-8f4c-96cedb1e0705 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:48.528705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d2e19-85dd-4a02-8f4c-96cedb1e0705 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:48.530343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d2e19-85dd-4a02-8f4c-96cedb1e0705 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:48.533846 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:48.545315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-503d2e19-85dd-4a02-8f4c-96cedb1e0705 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:48.545315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:48.545315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:48.545315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:48.545315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:48.545315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:48.545315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:48.545315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:48.545315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:48.545315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:48.545315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:48.545315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:48.545315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:18:48.545315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:18:48.545315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:18:48.546315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:18:48.546315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:48.546315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:48.546315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:48.546315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:48.546315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:48.546315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:48.546315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:48.546315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:48.546315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:48.546315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:48.546315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:48.546315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:48.546315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:48.546315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:48.546315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:48.546315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:48.547713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:18:48.547713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:18:48.547713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:18:48.547713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:18:48.547713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:18:48.547713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:18:48.547713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:48.547713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:48.547713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 325/656] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:48.549084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d2e19-85dd-4a02-8f4c-96cedb1e0705 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:48.606007 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:48.658100 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774761d-3288-495d-899f-a1b3d56e2522 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:48.674984 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d2e19-85dd-4a02-8f4c-96cedb1e0705 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:48.705590 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671dfdc-2be4-4819-8f56-12007d34a98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:48.706223 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671dfdc-2be4-4819-8f56-12007d34a98b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:48.706465 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671dfdc-2be4-4819-8f56-12007d34a98b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:48.706731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671dfdc-2be4-4819-8f56-12007d34a98b None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:48.707458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671dfdc-2be4-4819-8f56-12007d34a98b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:48.707761 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671dfdc-2be4-4819-8f56-12007d34a98b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:48.709177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7671dfdc-2be4-4819-8f56-12007d34a98b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:48.715667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db090ba-e912-4b78-8666-5b3a3b5bdf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:48.716555 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db090ba-e912-4b78-8666-5b3a3b5bdf90 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:48.717054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db090ba-e912-4b78-8666-5b3a3b5bdf90 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:48.718202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db090ba-e912-4b78-8666-5b3a3b5bdf90 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:48.719082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db090ba-e912-4b78-8666-5b3a3b5bdf90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:48.720031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db090ba-e912-4b78-8666-5b3a3b5bdf90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:48.721473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db090ba-e912-4b78-8666-5b3a3b5bdf90 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:48.724306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 332/657] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:48.727740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671dfdc-2be4-4819-8f56-12007d34a98b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:48.735400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 326/658] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:48.736574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db090ba-e912-4b78-8666-5b3a3b5bdf90 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:48.809371 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:48.854593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671dfdc-2be4-4819-8f56-12007d34a98b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:48.857236 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db090ba-e912-4b78-8666-5b3a3b5bdf90 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:48.893635 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128fc9c-652c-4f54-92f4-16b0e6adcf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:48.894305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128fc9c-652c-4f54-92f4-16b0e6adcf64 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:48.894585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128fc9c-652c-4f54-92f4-16b0e6adcf64 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:48.894994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128fc9c-652c-4f54-92f4-16b0e6adcf64 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:48.895128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:48.900423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6b4aa-d7a5-4c21-90c0-1c874cc151f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:48.901295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6b4aa-d7a5-4c21-90c0-1c874cc151f1 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:48.901797 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6b4aa-d7a5-4c21-90c0-1c874cc151f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:48.902273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6b4aa-d7a5-4c21-90c0-1c874cc151f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:48.903508 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6b4aa-d7a5-4c21-90c0-1c874cc151f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:48.903707 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128fc9c-652c-4f54-92f4-16b0e6adcf64 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:48.904202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6b4aa-d7a5-4c21-90c0-1c874cc151f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:48.905147 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128fc9c-652c-4f54-92f4-16b0e6adcf64 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:48.906245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6b4aa-d7a5-4c21-90c0-1c874cc151f1 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:48.918674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-e128fc9c-652c-4f54-92f4-16b0e6adcf64 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 19:18:48.918674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:48.918674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:48.918674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:48.918674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:48.918674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:48.918674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:48.918674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:48.918674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:48.918674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:48.918674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:48.918674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:48.918674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:18:48.918674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:18:48.918674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:18:48.918674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:18:48.919712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:48.919712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:48.919712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:18:48.919712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:48.919712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:18:48.919712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:48.919712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:48.919712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:48.919712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:48.919712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:48.919712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:48.919712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:48.919712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:48.919712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:48.919712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:48.919712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:48.919712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:48.919712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:48.921273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:48.921273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:48.921273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:18:48.921273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:18:48.921273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:18:48.921273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:18:48.921273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:18:48.921273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:18:48.921273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 19:18:48.921273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:48.921273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 327/659] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:18:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:48.921273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128fc9c-652c-4f54-92f4-16b0e6adcf64 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:48.926699 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 333/660] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:18:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:48.927782 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6b4aa-d7a5-4c21-90c0-1c874cc151f1 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:49.031188 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128fc9c-652c-4f54-92f4-16b0e6adcf64 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:49.052237 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:49.053331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6b4aa-d7a5-4c21-90c0-1c874cc151f1 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:49.067244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b25be-7a55-4a69-bd1e-c0afdce5cbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:49.067873 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b25be-7a55-4a69-bd1e-c0afdce5cbde None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:49.068145 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b25be-7a55-4a69-bd1e-c0afdce5cbde None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:49.068409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b25be-7a55-4a69-bd1e-c0afdce5cbde None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:49.076125 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b25be-7a55-4a69-bd1e-c0afdce5cbde None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:49.077592 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b25be-7a55-4a69-bd1e-c0afdce5cbde None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:49.089435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-635b25be-7a55-4a69-bd1e-c0afdce5cbde None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:18:49.089435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:49.089435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:49.089435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:49.089435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:49.089435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:49.089435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:49.089435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:49.089435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:49.089435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:49.089435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:49.089435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:49.089435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:18:49.089435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:18:49.089435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:18:49.089435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:18:49.090411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:49.090411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:49.090411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:18:49.090411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:49.090411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:18:49.090411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:49.090411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:49.090411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:49.090411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:49.090411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:49.090411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:49.090411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:49.090411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:49.090411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:49.090411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:49.090411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:49.090411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:49.090411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:49.091819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:49.091819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:49.091819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:18:49.091819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:18:49.091819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:18:49.091819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:18:49.091819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:18:49.091819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:18:49.091819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:18:49.091819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:49.091819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 328/661] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:49.091819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b25be-7a55-4a69-bd1e-c0afdce5cbde None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:49.098223 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0dd1b-6d2a-43b6-9603-ed9100cf322a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:49.098818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0dd1b-6d2a-43b6-9603-ed9100cf322a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:49.099110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0dd1b-6d2a-43b6-9603-ed9100cf322a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:49.099375 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0dd1b-6d2a-43b6-9603-ed9100cf322a None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:49.100149 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0dd1b-6d2a-43b6-9603-ed9100cf322a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:49.100452 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0dd1b-6d2a-43b6-9603-ed9100cf322a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:49.101858 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0dd1b-6d2a-43b6-9603-ed9100cf322a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:49.121443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 334/662] 10.222.0.25 () {56 vars in 1139 bytes} [Sat Sep 24 19:18:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:49.123161 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1228b-4fb2-4f6b-bf42-4f535bee9a30 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:49.123447 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1228b-4fb2-4f6b-bf42-4f535bee9a30 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:49.123721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1228b-4fb2-4f6b-bf42-4f535bee9a30 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:49.126865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 335/663] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:49.126865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1228b-4fb2-4f6b-bf42-4f535bee9a30 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:49.176489 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:49.207486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b25be-7a55-4a69-bd1e-c0afdce5cbde None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:49.236860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1228b-4fb2-4f6b-bf42-4f535bee9a30 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:49.242877 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d9321-2e32-4302-85e0-7a4ccc8e7357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:49.243481 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d9321-2e32-4302-85e0-7a4ccc8e7357 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:49.243894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d9321-2e32-4302-85e0-7a4ccc8e7357 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:49.244169 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d9321-2e32-4302-85e0-7a4ccc8e7357 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:49.244878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d9321-2e32-4302-85e0-7a4ccc8e7357 None admin] RBAC: Adding query filter params (role.id=a2673fe5628247c3a918eaa28d483e9f, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=54232cb318b04e9286f58dae8b2a3fd4) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:49.245181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d9321-2e32-4302-85e0-7a4ccc8e7357 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:49.246594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d9321-2e32-4302-85e0-7a4ccc8e7357 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:49.263172 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 329/664] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:18:49 2022] GET /identity/v3/role_assignments?user.id=54232cb318b04e9286f58dae8b2a3fd4&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=a2673fe5628247c3a918eaa28d483e9f => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:49.263172 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d9321-2e32-4302-85e0-7a4ccc8e7357 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:49.274525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a8e4c-5719-45ab-9499-810ace90134d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:49.275229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a8e4c-5719-45ab-9499-810ace90134d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:49.275510 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a8e4c-5719-45ab-9499-810ace90134d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:49.275782 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a8e4c-5719-45ab-9499-810ace90134d None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:49.276525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a8e4c-5719-45ab-9499-810ace90134d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:49.276830 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a8e4c-5719-45ab-9499-810ace90134d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:49.278310 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a8e4c-5719-45ab-9499-810ace90134d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:49.298910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 336/665] 10.222.0.25 () {56 vars in 1137 bytes} [Sat Sep 24 19:18:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:49.300253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f968f95-e088-4137-8a1f-2183fb42103e None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:49.300550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f968f95-e088-4137-8a1f-2183fb42103e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:49.300826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f968f95-e088-4137-8a1f-2183fb42103e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:49.320735 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-1f968f95-e088-4137-8a1f-2183fb42103e None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:49.322593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1f968f95-e088-4137-8a1f-2183fb42103e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:49.327255 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:49.395336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d9321-2e32-4302-85e0-7a4ccc8e7357 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:49.411843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 337/666] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:49.422064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f968f95-e088-4137-8a1f-2183fb42103e None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:49.460819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018285ec-53d5-442e-aa31-178b5c085557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:49.461454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018285ec-53d5-442e-aa31-178b5c085557 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:49.461736 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018285ec-53d5-442e-aa31-178b5c085557 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:49.462011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018285ec-53d5-442e-aa31-178b5c085557 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:49.483831 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:49.555727 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018285ec-53d5-442e-aa31-178b5c085557 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:49.557686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018285ec-53d5-442e-aa31-178b5c085557 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:49.564624 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f968f95-e088-4137-8a1f-2183fb42103e None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:49.604167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a534e-eaff-4941-a1e7-3ec3b9b50efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:49.604776 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a534e-eaff-4941-a1e7-3ec3b9b50efe None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:49.605101 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a534e-eaff-4941-a1e7-3ec3b9b50efe None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:49.605373 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a534e-eaff-4941-a1e7-3ec3b9b50efe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:49.610231 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:49.674721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 330/667] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:18:49.679129 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a534e-eaff-4941-a1e7-3ec3b9b50efe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:49.679129 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a534e-eaff-4941-a1e7-3ec3b9b50efe None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:49.681032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018285ec-53d5-442e-aa31-178b5c085557 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:49.709378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:49.794357 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 338/668] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:18:49.795691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a534e-eaff-4941-a1e7-3ec3b9b50efe None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:49.805740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018285ec-53d5-442e-aa31-178b5c085557 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:49.857024 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01025a26-1128-4bb9-9839-add2e2318bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:49.857926 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01025a26-1128-4bb9-9839-add2e2318bdb None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:49.858208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01025a26-1128-4bb9-9839-add2e2318bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:49.858473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01025a26-1128-4bb9-9839-add2e2318bdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:49.872321 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01025a26-1128-4bb9-9839-add2e2318bdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:49.873902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01025a26-1128-4bb9-9839-add2e2318bdb None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:49.876752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:49.892671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-01025a26-1128-4bb9-9839-add2e2318bdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:49.892671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:49.892671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:49.892671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:49.892671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:49.892671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:49.892671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:49.892671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:49.892671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:49.892671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:49.892671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:49.892671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:49.892671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:49.892671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:49.892671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:49.892671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:49.893709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:49.893709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:49.893709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:49.893709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:49.893709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:49.893709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:49.893709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:49.893709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:49.893709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:49.893709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:49.893709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:49.893709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:49.893709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:49.893709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:49.893709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:49.893709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:49.893709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:49.894619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:49.894619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:49.894619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:49.894619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 331/669] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:18:49.894878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01025a26-1128-4bb9-9839-add2e2318bdb None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:49.911253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a534e-eaff-4941-a1e7-3ec3b9b50efe None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:49.946756 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:49.954405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb377c25-295d-4b6a-a3d7-6cd33b626793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:49.955520 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb377c25-295d-4b6a-a3d7-6cd33b626793 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:49.956371 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb377c25-295d-4b6a-a3d7-6cd33b626793 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:49.956928 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb377c25-295d-4b6a-a3d7-6cd33b626793 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:49.969333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb377c25-295d-4b6a-a3d7-6cd33b626793 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:49.976061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-eb377c25-295d-4b6a-a3d7-6cd33b626793 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:49.976061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:49.976061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:49.976061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:49.976061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:49.976061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:49.976061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:49.976061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:49.976061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:49.976061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:49.976061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:49.976061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:49.976061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:49.976061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:49.976061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:49.976061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:49.977198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:49.977198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:49.977198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:49.977198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:49.977198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:49.977198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:49.977198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:49.977198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:49.977198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:49.977198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:49.977198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:49.977198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:49.977198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:49.977198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:49.977198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:49.977198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:49.978899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:49.978899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:49.978899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:49.978899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:49.978899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:49.978899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:49.978899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:49.978899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:49.978899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:49.978899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:49.978899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:49.978899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:49.981779 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 339/670] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:18:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:49.982704 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb377c25-295d-4b6a-a3d7-6cd33b626793 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:50.012057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01025a26-1128-4bb9-9839-add2e2318bdb None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:50.049318 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a05ae-ed5c-45c4-87ce-8f2615f501e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:50.050153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a05ae-ed5c-45c4-87ce-8f2615f501e8 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:50.050467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a05ae-ed5c-45c4-87ce-8f2615f501e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:50.050853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a05ae-ed5c-45c4-87ce-8f2615f501e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:50.063655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a05ae-ed5c-45c4-87ce-8f2615f501e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:50.065235 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a05ae-ed5c-45c4-87ce-8f2615f501e8 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:50.080840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-8c6a05ae-ed5c-45c4-87ce-8f2615f501e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:50.080840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:50.080840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:50.080840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:50.080840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:50.080840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:50.080840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:50.080840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:50.080840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:50.080840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:50.080840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:50.080840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:50.080840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:50.080840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:50.080840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:50.080840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:50.081963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:50.081963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:50.081963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:50.081963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:50.081963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:50.081963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:50.081963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:50.081963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:50.081963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:50.081963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:50.081963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:50.081963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:50.081963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:50.081963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:50.081963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:50.081963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:50.081963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:50.082876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:50.082876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:50.082876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:50.087180 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 332/671] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:50.088546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a05ae-ed5c-45c4-87ce-8f2615f501e8 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:50.108752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb377c25-295d-4b6a-a3d7-6cd33b626793 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:50.146309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0f596-3862-4b0b-90d2-f52fa80f6172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:50.146749 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0f596-3862-4b0b-90d2-f52fa80f6172 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:50.147058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0f596-3862-4b0b-90d2-f52fa80f6172 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:50.147332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0f596-3862-4b0b-90d2-f52fa80f6172 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:50.147956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0f596-3862-4b0b-90d2-f52fa80f6172 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:50.148258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0f596-3862-4b0b-90d2-f52fa80f6172 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:50.150181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0f596-3862-4b0b-90d2-f52fa80f6172 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:50.156087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:50.162653 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 340/672] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:50.163504 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0f596-3862-4b0b-90d2-f52fa80f6172 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:50.211345 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a05ae-ed5c-45c4-87ce-8f2615f501e8 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:50.219495 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:50.255138 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9599ad-e7f4-4866-bbd5-a666b5176e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:50.256119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9599ad-e7f4-4866-bbd5-a666b5176e9d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:50.256590 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9599ad-e7f4-4866-bbd5-a666b5176e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:50.257157 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9599ad-e7f4-4866-bbd5-a666b5176e9d None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:50.258007 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9599ad-e7f4-4866-bbd5-a666b5176e9d None admin] RBAC: Adding query filter params (name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:50.258502 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9599ad-e7f4-4866-bbd5-a666b5176e9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:50.260830 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9599ad-e7f4-4866-bbd5-a666b5176e9d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:50.269992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0f596-3862-4b0b-90d2-f52fa80f6172 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:50.275657 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 333/673] 10.222.0.25 () {56 vars in 1103 bytes} [Sat Sep 24 19:18:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:50.276788 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9599ad-e7f4-4866-bbd5-a666b5176e9d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:50.306864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07e683-fa5d-441c-9246-8d5ecf35a352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:50.307382 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07e683-fa5d-441c-9246-8d5ecf35a352 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:50.307694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07e683-fa5d-441c-9246-8d5ecf35a352 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:50.307921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07e683-fa5d-441c-9246-8d5ecf35a352 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:50.308558 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07e683-fa5d-441c-9246-8d5ecf35a352 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:50.308858 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07e683-fa5d-441c-9246-8d5ecf35a352 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:50.310240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07e683-fa5d-441c-9246-8d5ecf35a352 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:50.327945 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 341/674] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:50.327945 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07e683-fa5d-441c-9246-8d5ecf35a352 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:50.396652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9599ad-e7f4-4866-bbd5-a666b5176e9d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:50.418711 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:50.432423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07e683-fa5d-441c-9246-8d5ecf35a352 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:50.445892 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:50.448633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31e489-e89e-4e25-b590-dcc15ecde719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:50.449909 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31e489-e89e-4e25-b590-dcc15ecde719 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:50.450412 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31e489-e89e-4e25-b590-dcc15ecde719 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:50.451353 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31e489-e89e-4e25-b590-dcc15ecde719 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:50.459014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31e489-e89e-4e25-b590-dcc15ecde719 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:50.460922 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31e489-e89e-4e25-b590-dcc15ecde719 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:50.468666 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffd1b9-9e0a-442f-ac76-8ed98f133159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:50.469230 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffd1b9-9e0a-442f-ac76-8ed98f133159 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:50.469504 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffd1b9-9e0a-442f-ac76-8ed98f133159 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:50.469772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffd1b9-9e0a-442f-ac76-8ed98f133159 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:50.475716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-5e31e489-e89e-4e25-b590-dcc15ecde719 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:50.475716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:50.475716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:50.475716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:50.475716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:50.475716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:50.475716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:50.475716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:50.475716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:50.475716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:50.475716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:50.475716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:50.475716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:18:50.475716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:18:50.475716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:18:50.476612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:18:50.476612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:50.476612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:50.476612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:50.476612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:50.476612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:50.476612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:50.476612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:50.476612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:50.476612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:50.476612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:50.476612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:50.476612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:50.476612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:50.476612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:50.476612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:50.476612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:50.477515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:18:50.477515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:18:50.477515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:18:50.477515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:18:50.477515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:18:50.477515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:18:50.477515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:50.477515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:50.480366 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 334/675] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:50.480810 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ffd1b9-9e0a-442f-ac76-8ed98f133159 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:50.481701 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31e489-e89e-4e25-b590-dcc15ecde719 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:50.482413 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ffd1b9-9e0a-442f-ac76-8ed98f133159 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:50.499437 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-67ffd1b9-9e0a-442f-ac76-8ed98f133159 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:50.499437 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:50.499437 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:50.499437 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:50.499437 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:50.499437 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:50.499437 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:50.499437 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:50.499437 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:50.499437 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:50.499437 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:50.499437 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:50.499437 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:50.499437 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:50.499437 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:50.499437 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:50.500884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:50.500884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:50.500884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:50.500884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:50.500884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:50.500884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:50.500884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:50.500884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:50.500884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:50.500884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:50.500884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:50.500884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:50.500884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:50.500884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:50.500884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:50.500884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:50.500884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:50.501816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:50.501816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:50.501816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:50.501816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 342/676] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:50.501816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffd1b9-9e0a-442f-ac76-8ed98f133159 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:50.629322 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffd1b9-9e0a-442f-ac76-8ed98f133159 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:50.642220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31e489-e89e-4e25-b590-dcc15ecde719 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:50.665034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e404d4-a829-404f-a7f6-da241759d617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:50.665807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e404d4-a829-404f-a7f6-da241759d617 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:50.666086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e404d4-a829-404f-a7f6-da241759d617 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:50.666355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e404d4-a829-404f-a7f6-da241759d617 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:50.667055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e404d4-a829-404f-a7f6-da241759d617 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:50.667356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e404d4-a829-404f-a7f6-da241759d617 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:50.668772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e404d4-a829-404f-a7f6-da241759d617 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:50.682277 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 343/677] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:18:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:50.683317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e404d4-a829-404f-a7f6-da241759d617 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:50.689160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801eeb1-9323-41db-a569-b87dc4be3426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:50.689922 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801eeb1-9323-41db-a569-b87dc4be3426 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:50.690299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801eeb1-9323-41db-a569-b87dc4be3426 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:50.690669 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801eeb1-9323-41db-a569-b87dc4be3426 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:50.700489 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801eeb1-9323-41db-a569-b87dc4be3426 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:50.702503 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801eeb1-9323-41db-a569-b87dc4be3426 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:50.708401 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:50.718109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-5801eeb1-9323-41db-a569-b87dc4be3426 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:50.718109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:50.718109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:50.718109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:50.718109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:50.718109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:50.718109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:50.718109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:50.718109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:50.718109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:50.718109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:50.718109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:50.718109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:18:50.718109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:18:50.718109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:18:50.719335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:18:50.719335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:50.719335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:50.719335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:50.719335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:50.719335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:50.719335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:50.719335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:50.719335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:50.719335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:50.719335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:50.719335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:50.719335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:50.719335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:50.719335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:50.719335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:50.719335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:50.720451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:18:50.720451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:18:50.720451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:18:50.720451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:18:50.720451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:18:50.720451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:18:50.720451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:50.720451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:50.722040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 335/678] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:50.723158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801eeb1-9323-41db-a569-b87dc4be3426 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:50.763463 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:50.817802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e404d4-a829-404f-a7f6-da241759d617 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:50.843610 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801eeb1-9323-41db-a569-b87dc4be3426 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:50.864833 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f860f-092a-4c78-b05c-8dddd93ace24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:50.865437 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f860f-092a-4c78-b05c-8dddd93ace24 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:50.865716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f860f-092a-4c78-b05c-8dddd93ace24 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:50.865988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f860f-092a-4c78-b05c-8dddd93ace24 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:50.866631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f860f-092a-4c78-b05c-8dddd93ace24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:50.866970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f860f-092a-4c78-b05c-8dddd93ace24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:50.868335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f860f-092a-4c78-b05c-8dddd93ace24 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:50.880508 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 344/679] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:50.881339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f860f-092a-4c78-b05c-8dddd93ace24 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:50.887652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132907b-3d22-4257-8c88-82af8d1d2a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:50.888264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132907b-3d22-4257-8c88-82af8d1d2a62 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:50.888538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132907b-3d22-4257-8c88-82af8d1d2a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:50.888801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132907b-3d22-4257-8c88-82af8d1d2a62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:50.889528 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132907b-3d22-4257-8c88-82af8d1d2a62 None admin] RBAC: Adding query filter params (role.id=a2673fe5628247c3a918eaa28d483e9f, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=1763ed41f99a4778b3df6eebcc6d94e8) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:50.889834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132907b-3d22-4257-8c88-82af8d1d2a62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:50.891722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132907b-3d22-4257-8c88-82af8d1d2a62 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:50.898436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 336/680] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:18:50 2022] GET /identity/v3/role_assignments?user.id=1763ed41f99a4778b3df6eebcc6d94e8&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=a2673fe5628247c3a918eaa28d483e9f => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:50.900280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f769b7-5483-4275-a00b-2cfeb43fabf5 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:50.900653 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f769b7-5483-4275-a00b-2cfeb43fabf5 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:50.900935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f769b7-5483-4275-a00b-2cfeb43fabf5 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:50.902613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 337/681] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:50.903370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f769b7-5483-4275-a00b-2cfeb43fabf5 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:50.995912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:51.016529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:51.019039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f860f-092a-4c78-b05c-8dddd93ace24 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:51.026563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f769b7-5483-4275-a00b-2cfeb43fabf5 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:51.069000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b77c19-0016-4e6f-a546-294846693365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:51.069649 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b77c19-0016-4e6f-a546-294846693365 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:51.069924 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b77c19-0016-4e6f-a546-294846693365 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:51.070199 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b77c19-0016-4e6f-a546-294846693365 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:51.070919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b77c19-0016-4e6f-a546-294846693365 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:51.071209 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b77c19-0016-4e6f-a546-294846693365 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:51.073224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b77c19-0016-4e6f-a546-294846693365 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:51.073861 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df3193-dbb9-45a0-9cf3-fedc61335050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:51.074798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df3193-dbb9-45a0-9cf3-fedc61335050 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:51.075635 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df3193-dbb9-45a0-9cf3-fedc61335050 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:51.076144 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df3193-dbb9-45a0-9cf3-fedc61335050 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:51.092249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 345/682] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:18:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:51.092249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acfcae-e854-44b7-91f0-e7f605c459c2 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:51.092249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acfcae-e854-44b7-91f0-e7f605c459c2 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:51.092249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acfcae-e854-44b7-91f0-e7f605c459c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:51.093083 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df3193-dbb9-45a0-9cf3-fedc61335050 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:51.095113 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df3193-dbb9-45a0-9cf3-fedc61335050 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:51.109994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-73df3193-dbb9-45a0-9cf3-fedc61335050 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:18:51.109994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:51.109994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:51.109994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:51.109994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:51.109994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:51.109994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:51.109994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:51.109994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:51.109994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:51.109994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:51.109994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:51.109994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:18:51.109994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:18:51.109994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:18:51.109994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:18:51.111052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:51.111052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:51.111052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:18:51.111052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:51.111052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:18:51.111052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:51.111052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:51.111052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:51.111052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:51.111052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:51.111052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:51.111052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:51.111052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:51.111052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:51.111052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:51.111052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:51.111052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:51.111052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:51.111994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:51.111994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:51.111994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:18:51.111994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:18:51.111994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:18:51.111994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:18:51.111994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:18:51.111994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:18:51.111994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:18:51.111994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:51.111994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 338/683] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:18:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:51.111994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df3193-dbb9-45a0-9cf3-fedc61335050 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:51.114923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-30acfcae-e854-44b7-91f0-e7f605c459c2 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:51.115757 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-30acfcae-e854-44b7-91f0-e7f605c459c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:51.196085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 346/684] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:51.197405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acfcae-e854-44b7-91f0-e7f605c459c2 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:51.232115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df3193-dbb9-45a0-9cf3-fedc61335050 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:51.282424 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:51.299617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2719a0-db2d-4d82-9bd6-f267c5d5a5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:51.300246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2719a0-db2d-4d82-9bd6-f267c5d5a5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:51.300533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2719a0-db2d-4d82-9bd6-f267c5d5a5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:51.300836 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2719a0-db2d-4d82-9bd6-f267c5d5a5b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:51.301547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2719a0-db2d-4d82-9bd6-f267c5d5a5b1 None admin] RBAC: Adding query filter params (role.id=a2673fe5628247c3a918eaa28d483e9f, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=5840a13ddf8c45f2bf97a4f6d4a48d96) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:51.301857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2719a0-db2d-4d82-9bd6-f267c5d5a5b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:51.303327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2719a0-db2d-4d82-9bd6-f267c5d5a5b1 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:51.310591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 339/685] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:18:51 2022] GET /identity/v3/role_assignments?user.id=5840a13ddf8c45f2bf97a4f6d4a48d96&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=a2673fe5628247c3a918eaa28d483e9f => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:51.314353 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acfcae-e854-44b7-91f0-e7f605c459c2 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:51.356324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49707d7-47c8-4c2f-82cd-243a50394eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:51.357342 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49707d7-47c8-4c2f-82cd-243a50394eee None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:51.357815 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49707d7-47c8-4c2f-82cd-243a50394eee None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:51.358400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49707d7-47c8-4c2f-82cd-243a50394eee None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:51.359341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49707d7-47c8-4c2f-82cd-243a50394eee None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:51.359839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49707d7-47c8-4c2f-82cd-243a50394eee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:51.361447 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49707d7-47c8-4c2f-82cd-243a50394eee None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:51.382677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 347/686] 10.222.0.25 () {56 vars in 1135 bytes} [Sat Sep 24 19:18:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:51.388264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2719a0-db2d-4d82-9bd6-f267c5d5a5b1 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:51.420135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:51.518148 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2719a0-db2d-4d82-9bd6-f267c5d5a5b1 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:51.541900 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49707d7-47c8-4c2f-82cd-243a50394eee None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:51.561771 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7788200-711e-441b-8f3a-0201bb416cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:51.562398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7788200-711e-441b-8f3a-0201bb416cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:51.562671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7788200-711e-441b-8f3a-0201bb416cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:51.563035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7788200-711e-441b-8f3a-0201bb416cc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:51.685554 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7788200-711e-441b-8f3a-0201bb416cc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:51.687182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7788200-711e-441b-8f3a-0201bb416cc7 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:51.700925 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49707d7-47c8-4c2f-82cd-243a50394eee None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:51.715237 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:51.742409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:51.749011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6afc1b-1cd4-40a2-9dba-645187e28520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:51.749650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6afc1b-1cd4-40a2-9dba-645187e28520 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:51.749929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6afc1b-1cd4-40a2-9dba-645187e28520 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:51.750204 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6afc1b-1cd4-40a2-9dba-645187e28520 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:51.764011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6afc1b-1cd4-40a2-9dba-645187e28520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:51.770066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-6f6afc1b-1cd4-40a2-9dba-645187e28520 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:18:51.770066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:51.770066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:51.770066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:51.770066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:51.770066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:51.770066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:51.770066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:51.770066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:51.770066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:51.770066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:51.770066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:51.770066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:51.770066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:51.770066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:51.770066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:51.771031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:51.771031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:51.771031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:51.771031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:51.771031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:51.771031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:51.771031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:51.771031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:51.771031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:51.771031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:51.771031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:51.771031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:51.771031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:51.771031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:51.771031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:51.771031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:51.771871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:51.771871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:51.771871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:51.771871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:51.771871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:51.771871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:51.771871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:51.771871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:51.771871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:51.771871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:51.771871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:18:51.771871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:51.774720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 348/687] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:18:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:51.780543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6afc1b-1cd4-40a2-9dba-645187e28520 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:51.804842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 340/688] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 19:18:51.812298 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7788200-711e-441b-8f3a-0201bb416cc7 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:51.955995 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6afc1b-1cd4-40a2-9dba-645187e28520 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:51.972059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7788200-711e-441b-8f3a-0201bb416cc7 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:51.992365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:52.009265 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77899b91-c654-4c6f-8c0f-1183ab84bf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:52.010536 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77899b91-c654-4c6f-8c0f-1183ab84bf34 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:52.011040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77899b91-c654-4c6f-8c0f-1183ab84bf34 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:52.011664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77899b91-c654-4c6f-8c0f-1183ab84bf34 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:52.012534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77899b91-c654-4c6f-8c0f-1183ab84bf34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:52.012727 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66a383-7e3b-47f1-8281-70f68db85cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:52.013226 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77899b91-c654-4c6f-8c0f-1183ab84bf34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:52.013330 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66a383-7e3b-47f1-8281-70f68db85cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:52.013588 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66a383-7e3b-47f1-8281-70f68db85cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:52.013855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66a383-7e3b-47f1-8281-70f68db85cf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:52.015348 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77899b91-c654-4c6f-8c0f-1183ab84bf34 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:52.025820 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66a383-7e3b-47f1-8281-70f68db85cf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:52.027549 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66a383-7e3b-47f1-8281-70f68db85cf6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:52.027987 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 349/689] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:52.029759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174d718-8823-4807-90ed-75670c9a5366 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:52.030230 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174d718-8823-4807-90ed-75670c9a5366 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:52.031124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174d718-8823-4807-90ed-75670c9a5366 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:52.032534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 350/690] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:52.033424 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174d718-8823-4807-90ed-75670c9a5366 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:52.051847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-7a66a383-7e3b-47f1-8281-70f68db85cf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:52.051847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:52.051847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:52.051847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:52.051847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:52.051847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:52.051847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:52.051847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:52.051847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:52.051847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:52.051847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:52.051847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:52.051847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:52.051847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:52.051847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:52.051847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:52.052839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:52.052839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:52.052839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:52.052839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:52.052839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:52.052839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:52.052839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:52.052839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:52.052839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:52.052839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:52.052839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:52.052839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:52.052839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:52.052839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:52.052839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:52.052839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:52.052839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:52.053782 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:52.053782 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:52.053782 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:52.057088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 341/691] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:18:52.063201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076b546-92a8-4d85-be68-a4c43a3690b5 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:52.063748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076b546-92a8-4d85-be68-a4c43a3690b5 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:52.064158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076b546-92a8-4d85-be68-a4c43a3690b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:52.084160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-8076b546-92a8-4d85-be68-a4c43a3690b5 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:52.085648 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8076b546-92a8-4d85-be68-a4c43a3690b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:52.104878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:52.156363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174d718-8823-4807-90ed-75670c9a5366 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:52.163450 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 342/692] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:52.164344 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076b546-92a8-4d85-be68-a4c43a3690b5 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:52.220570 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633bd9c-b617-483a-b185-16d1502ab8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:52.221220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633bd9c-b617-483a-b185-16d1502ab8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:52.221499 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633bd9c-b617-483a-b185-16d1502ab8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:52.221775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633bd9c-b617-483a-b185-16d1502ab8d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:52.239020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633bd9c-b617-483a-b185-16d1502ab8d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:52.240875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633bd9c-b617-483a-b185-16d1502ab8d3 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:52.272934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-3633bd9c-b617-483a-b185-16d1502ab8d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:52.272934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:52.272934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:52.272934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:52.272934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:52.272934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:52.272934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:52.272934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:52.272934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:52.272934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:52.272934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:52.272934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:52.272934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:52.272934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:52.272934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:52.272934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:52.274178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:52.274178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:52.274178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:52.274178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:52.274178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:52.274178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:52.274178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:52.274178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:52.274178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:52.274178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:52.274178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:52.274178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:52.274178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:52.274178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:52.274178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:52.274178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:52.274178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:52.275677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:52.275677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:52.275677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:52.277394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 351/693] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:52.282884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633bd9c-b617-483a-b185-16d1502ab8d3 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:52.284695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:52.289728 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076b546-92a8-4d85-be68-a4c43a3690b5 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:52.357106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b687991-61b7-4941-bc79-10f2d1d09275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:52.358057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b687991-61b7-4941-bc79-10f2d1d09275 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:52.358517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b687991-61b7-4941-bc79-10f2d1d09275 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:52.358994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b687991-61b7-4941-bc79-10f2d1d09275 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:52.360087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b687991-61b7-4941-bc79-10f2d1d09275 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:52.361550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b687991-61b7-4941-bc79-10f2d1d09275 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:52.366433 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b687991-61b7-4941-bc79-10f2d1d09275 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:52.388409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 343/694] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:52.394213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b687991-61b7-4941-bc79-10f2d1d09275 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:52.492053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633bd9c-b617-483a-b185-16d1502ab8d3 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:52.502788 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:52.544765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b687991-61b7-4941-bc79-10f2d1d09275 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:52.545625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db86cb7-756a-41fa-b1ed-d796bcaee13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:52.546511 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db86cb7-756a-41fa-b1ed-d796bcaee13c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:52.546783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db86cb7-756a-41fa-b1ed-d796bcaee13c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:52.547989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db86cb7-756a-41fa-b1ed-d796bcaee13c None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:52.548622 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db86cb7-756a-41fa-b1ed-d796bcaee13c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:52.548920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db86cb7-756a-41fa-b1ed-d796bcaee13c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:52.550272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db86cb7-756a-41fa-b1ed-d796bcaee13c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:52.566136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 352/695] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:52.566983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db86cb7-756a-41fa-b1ed-d796bcaee13c None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:52.588026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b3971-2101-49fe-80e0-da7b9e17ac84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:52.588669 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b3971-2101-49fe-80e0-da7b9e17ac84 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:52.588943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b3971-2101-49fe-80e0-da7b9e17ac84 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:52.589209 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b3971-2101-49fe-80e0-da7b9e17ac84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:52.596220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b3971-2101-49fe-80e0-da7b9e17ac84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:52.597648 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b3971-2101-49fe-80e0-da7b9e17ac84 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:52.609971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-027b3971-2101-49fe-80e0-da7b9e17ac84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:52.609971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:52.609971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:52.609971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:52.609971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:52.609971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:52.609971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:52.609971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:52.609971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:52.609971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:52.609971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:52.609971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:52.609971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:18:52.609971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:18:52.609971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:18:52.610948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:18:52.610948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:52.610948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:52.610948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:52.610948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:52.610948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:52.610948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:52.610948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:52.610948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:52.610948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:52.610948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:52.610948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:52.610948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:52.610948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:52.610948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:52.610948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:52.610948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:52.611844 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:18:52.611844 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:18:52.611844 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:18:52.611844 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:18:52.611844 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:18:52.611844 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:18:52.611844 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:52.611844 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:52.611844 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 344/696] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:52.612344 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b3971-2101-49fe-80e0-da7b9e17ac84 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:52.637048 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:52.680215 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db86cb7-756a-41fa-b1ed-d796bcaee13c None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:52.716758 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1aba5-f93e-4c58-a3f0-def3e9e9c9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:52.717396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1aba5-f93e-4c58-a3f0-def3e9e9c9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:52.717654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1aba5-f93e-4c58-a3f0-def3e9e9c9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:52.717922 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1aba5-f93e-4c58-a3f0-def3e9e9c9d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:52.720180 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b3971-2101-49fe-80e0-da7b9e17ac84 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:52.728758 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1aba5-f93e-4c58-a3f0-def3e9e9c9d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:52.730197 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1aba5-f93e-4c58-a3f0-def3e9e9c9d7 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:52.746534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-d4d1aba5-f93e-4c58-a3f0-def3e9e9c9d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:52.746534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:52.746534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:52.746534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:52.746534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:52.746534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:52.746534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:52.746534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:52.746534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:52.746534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:52.746534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:52.746534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:52.746534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:52.746534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:52.746534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:52.746534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:52.748733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:52.748733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:52.748733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:52.748733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:52.748733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:52.748733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:52.748733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:52.748733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:52.748733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:52.748733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:52.748733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:52.748733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:52.748733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:52.748733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:52.748733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:52.748733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:52.748733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:52.750925 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:52.750925 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:52.750925 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:52.758859 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 353/697] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:52.758859 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1aba5-f93e-4c58-a3f0-def3e9e9c9d7 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:52.759291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f6e29-f1d8-42a8-a4de-2c6d00d1d24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:52.759291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f6e29-f1d8-42a8-a4de-2c6d00d1d24b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:52.759291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f6e29-f1d8-42a8-a4de-2c6d00d1d24b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:52.759291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f6e29-f1d8-42a8-a4de-2c6d00d1d24b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:52.764953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f6e29-f1d8-42a8-a4de-2c6d00d1d24b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:52.766439 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f6e29-f1d8-42a8-a4de-2c6d00d1d24b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:52.774026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:52.779021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-f98f6e29-f1d8-42a8-a4de-2c6d00d1d24b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:18:52.779021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:52.779021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:52.779021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:52.779021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:52.779021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:52.779021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:52.779021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:52.779021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:52.779021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:52.779021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:52.779021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:52.779021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:18:52.779021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:18:52.779021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:18:52.779021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:18:52.780051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:52.780051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:52.780051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:18:52.780051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:52.780051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:18:52.780051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:52.780051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:52.780051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:52.780051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:52.780051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:52.780051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:52.780051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:52.780051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:52.780051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:52.780051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:52.780051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:52.780051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:52.780051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:52.781014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:52.781014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:52.781014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:18:52.781014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:18:52.781014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:18:52.781014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:18:52.781014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:18:52.781014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:18:52.781014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:18:52.781014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:52.784772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 345/698] 10.222.0.25 () {56 vars in 1093 bytes} [Sat Sep 24 19:18:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:52.785593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f6e29-f1d8-42a8-a4de-2c6d00d1d24b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:52.864549 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1aba5-f93e-4c58-a3f0-def3e9e9c9d7 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:52.870500 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:52.891623 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f6e29-f1d8-42a8-a4de-2c6d00d1d24b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:52.903174 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde0025-0992-4b05-9024-1dea62cc1aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:52.904015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde0025-0992-4b05-9024-1dea62cc1aab None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:52.904469 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde0025-0992-4b05-9024-1dea62cc1aab None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:52.904917 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde0025-0992-4b05-9024-1dea62cc1aab None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:52.905795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde0025-0992-4b05-9024-1dea62cc1aab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:52.906276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde0025-0992-4b05-9024-1dea62cc1aab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:52.907967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde0025-0992-4b05-9024-1dea62cc1aab None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:52.921722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 354/699] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:18:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:52.922858 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde0025-0992-4b05-9024-1dea62cc1aab None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:52.928051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248e772-7aee-4e6e-bbf3-08da0a2ad180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:52.928664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248e772-7aee-4e6e-bbf3-08da0a2ad180 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:52.928939 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248e772-7aee-4e6e-bbf3-08da0a2ad180 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:52.929207 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248e772-7aee-4e6e-bbf3-08da0a2ad180 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:52.929841 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248e772-7aee-4e6e-bbf3-08da0a2ad180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:52.930138 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248e772-7aee-4e6e-bbf3-08da0a2ad180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:52.932104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248e772-7aee-4e6e-bbf3-08da0a2ad180 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:52.949225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 346/700] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:52.949225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248e772-7aee-4e6e-bbf3-08da0a2ad180 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:53.018263 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:53.044315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde0025-0992-4b05-9024-1dea62cc1aab None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:53.052049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248e772-7aee-4e6e-bbf3-08da0a2ad180 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:53.083954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916eb3c-c414-4f41-9ad8-64be100ab585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:53.084913 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916eb3c-c414-4f41-9ad8-64be100ab585 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:53.085391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916eb3c-c414-4f41-9ad8-64be100ab585 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:53.085970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916eb3c-c414-4f41-9ad8-64be100ab585 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:53.086910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916eb3c-c414-4f41-9ad8-64be100ab585 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:53.087470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916eb3c-c414-4f41-9ad8-64be100ab585 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:53.089093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916eb3c-c414-4f41-9ad8-64be100ab585 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:53.089521 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dd138-100a-4fb1-b1f0-d00861c72c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:53.090123 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dd138-100a-4fb1-b1f0-d00861c72c44 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:53.090398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dd138-100a-4fb1-b1f0-d00861c72c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:53.090666 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dd138-100a-4fb1-b1f0-d00861c72c44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:53.091406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dd138-100a-4fb1-b1f0-d00861c72c44 None admin] RBAC: Adding query filter params (role.id=a2673fe5628247c3a918eaa28d483e9f, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=85b45de73f7b4f7da7e0e8d8375deb37) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:53.091707 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dd138-100a-4fb1-b1f0-d00861c72c44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:53.093106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dd138-100a-4fb1-b1f0-d00861c72c44 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:53.099304 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 347/701] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:18:52 2022] GET /identity/v3/role_assignments?user.id=85b45de73f7b4f7da7e0e8d8375deb37&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=a2673fe5628247c3a918eaa28d483e9f => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:53.100736 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dd138-100a-4fb1-b1f0-d00861c72c44 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:53.104055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:53.115555 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 355/702] 10.222.0.25 () {56 vars in 1133 bytes} [Sat Sep 24 19:18:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:53.116902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916eb3c-c414-4f41-9ad8-64be100ab585 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:53.214314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dd138-100a-4fb1-b1f0-d00861c72c44 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:53.229299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916eb3c-c414-4f41-9ad8-64be100ab585 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:53.251693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fcf2f-720e-4d9e-b470-cd257a37c524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:53.252306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fcf2f-720e-4d9e-b470-cd257a37c524 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:53.252583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fcf2f-720e-4d9e-b470-cd257a37c524 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:53.252852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fcf2f-720e-4d9e-b470-cd257a37c524 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:53.253492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85fcf2f-720e-4d9e-b470-cd257a37c524 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:53.254935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85fcf2f-720e-4d9e-b470-cd257a37c524 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:53.270065 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31d724-f855-417a-b91c-43f61a5de8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:53.271151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31d724-f855-417a-b91c-43f61a5de8e7 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:53.271633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31d724-f855-417a-b91c-43f61a5de8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:53.272119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31d724-f855-417a-b91c-43f61a5de8e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:53.279903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:53.294091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 348/703] 10.222.0.25 () {60 vars in 1132 bytes} [Sat Sep 24 19:18:53 2022] POST /identity/v3/users => generated 254 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:18:53.370380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31d724-f855-417a-b91c-43f61a5de8e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:53.372271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31d724-f855-417a-b91c-43f61a5de8e7 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:53.425454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58ccad-a2c3-4547-9b0f-aa501b765b4e None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:53.425454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58ccad-a2c3-4547-9b0f-aa501b765b4e None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:53.425454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58ccad-a2c3-4547-9b0f-aa501b765b4e None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:53.425454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 349/704] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:53.433417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebc374-7c81-4db5-8f8a-de19676b5cae None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:53.433727 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebc374-7c81-4db5-8f8a-de19676b5cae None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:53.433976 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ebc374-7c81-4db5-8f8a-de19676b5cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:53.460583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-e6ebc374-7c81-4db5-8f8a-de19676b5cae None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:53.462881 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e6ebc374-7c81-4db5-8f8a-de19676b5cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:53.491953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 356/705] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:18:53.499131 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31d724-f855-417a-b91c-43f61a5de8e7 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:53.550462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:53.552307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:53.570810 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 350/706] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:53.633257 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31d724-f855-417a-b91c-43f61a5de8e7 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:53.669978 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a79fd6-640c-4865-8764-8d43f0ec4257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:53.670605 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a79fd6-640c-4865-8764-8d43f0ec4257 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:53.670943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a79fd6-640c-4865-8764-8d43f0ec4257 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:53.671180 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a79fd6-640c-4865-8764-8d43f0ec4257 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:53.682128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a79fd6-640c-4865-8764-8d43f0ec4257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:53.683593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a79fd6-640c-4865-8764-8d43f0ec4257 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:53.699886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-65a79fd6-640c-4865-8764-8d43f0ec4257 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:53.699886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:53.699886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:53.699886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:53.699886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:53.699886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:53.699886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:53.699886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:53.699886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:53.699886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:53.699886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:53.699886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:53.699886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:53.699886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:53.699886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:53.699886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:53.700935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:53.700935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:53.700935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:53.700935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:53.700935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:53.700935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:53.700935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:53.700935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:53.700935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:53.700935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:53.700935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:53.700935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:53.700935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:53.700935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:53.700935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:53.700935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:53.700935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:53.702252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:53.702252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:53.702252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:53.702252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 357/707] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:18:53.706428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebc374-7c81-4db5-8f8a-de19676b5cae None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:53.818421 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ebc374-7c81-4db5-8f8a-de19676b5cae None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:53.859078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a0ebf-b53f-441a-bdb4-8b4a4a5ebaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:53.860042 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a0ebf-b53f-441a-bdb4-8b4a4a5ebaba None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:53.860549 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a0ebf-b53f-441a-bdb4-8b4a4a5ebaba None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:53.861013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a0ebf-b53f-441a-bdb4-8b4a4a5ebaba None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:53.861858 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a0ebf-b53f-441a-bdb4-8b4a4a5ebaba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:53.862350 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a0ebf-b53f-441a-bdb4-8b4a4a5ebaba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:53.863931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a0ebf-b53f-441a-bdb4-8b4a4a5ebaba None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:53.878910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 351/708] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:53.884557 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a79fd6-640c-4865-8764-8d43f0ec4257 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:53.912155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a0ebf-b53f-441a-bdb4-8b4a4a5ebaba None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:53.966389 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:53.997280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:54.013875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a79fd6-640c-4865-8764-8d43f0ec4257 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:54.038331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a0ebf-b53f-441a-bdb4-8b4a4a5ebaba None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:54.066543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c6f33-c314-4283-bbfe-33bb92e5e9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:54.067765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c6f33-c314-4283-bbfe-33bb92e5e9aa None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:54.068291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c6f33-c314-4283-bbfe-33bb92e5e9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:54.068852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c6f33-c314-4283-bbfe-33bb92e5e9aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:54.078391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c6f33-c314-4283-bbfe-33bb92e5e9aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:54.080278 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c6f33-c314-4283-bbfe-33bb92e5e9aa None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:54.094057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-6c4c6f33-c314-4283-bbfe-33bb92e5e9aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:54.094057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:54.094057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:54.094057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:54.094057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:54.094057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:54.094057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:54.094057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:54.094057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:54.094057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:54.094057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:54.094057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:54.094057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:18:54.094057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:18:54.094057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:18:54.095013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:18:54.095013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:54.095013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:54.095013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:54.095013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:54.095013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:54.095013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:54.095013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:54.095013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:54.095013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:54.095013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:54.095013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:54.095013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:54.095013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:54.095013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:54.095013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:54.095013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:54.095959 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:18:54.095959 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:18:54.095959 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:18:54.095959 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:18:54.095959 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:18:54.095959 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:18:54.095959 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:54.095959 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:54.098605 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 358/709] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:54.104353 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c6f33-c314-4283-bbfe-33bb92e5e9aa None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:54.116896 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f16287-bdeb-4022-8731-ba06f597b3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:54.117544 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f16287-bdeb-4022-8731-ba06f597b3a8 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:54.117821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f16287-bdeb-4022-8731-ba06f597b3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:54.118092 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f16287-bdeb-4022-8731-ba06f597b3a8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:54.118740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f16287-bdeb-4022-8731-ba06f597b3a8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:54.120212 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f16287-bdeb-4022-8731-ba06f597b3a8 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:54.141993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-98f16287-bdeb-4022-8731-ba06f597b3a8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:18:54.141993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:54.141993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:18:54.141993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:18:54.141993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:18:54.141993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:18:54.141993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:18:54.141993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:18:54.141993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:18:54.141993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:54.141993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:18:54.141993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:54.141993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:54.141993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:54.141993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:54.141993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:54.141993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:54.143082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:54.143082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:54.143082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:54.143082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:54.143082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:54.143082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:54.143082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:18:54.143082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:18:54.143082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:18:54.143082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:18:54.143082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:54.143082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:54.143082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:54.143082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:54.143082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:54.143082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:54.143964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:54.143964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:54.143964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:54.143964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:54.143964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:54.143964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:54.143964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:54.143964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:54.143964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:54.143964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:54.143964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:18:54.143964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:18:54.143964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:18:54.143964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:54.151533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 352/710] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:53 2022] GET /identity/v3/services/network => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:18:54.156888 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f16287-bdeb-4022-8731-ba06f597b3a8 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:54.232489 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c6f33-c314-4283-bbfe-33bb92e5e9aa None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:54.275199 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc971e8-6192-43f9-9fc0-198b1bd5e172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:54.276068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc971e8-6192-43f9-9fc0-198b1bd5e172 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:54.276336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc971e8-6192-43f9-9fc0-198b1bd5e172 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:54.276599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc971e8-6192-43f9-9fc0-198b1bd5e172 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:54.277279 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc971e8-6192-43f9-9fc0-198b1bd5e172 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:54.277576 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc971e8-6192-43f9-9fc0-198b1bd5e172 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:54.278201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f16287-bdeb-4022-8731-ba06f597b3a8 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:54.280389 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc971e8-6192-43f9-9fc0-198b1bd5e172 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:54.294281 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 359/711] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:18:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:54.294895 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:54.295738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781bbe2-c2de-4140-b643-1bd44940fa96 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:54.295877 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781bbe2-c2de-4140-b643-1bd44940fa96 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:54.296176 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781bbe2-c2de-4140-b643-1bd44940fa96 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:54.297762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 360/712] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:54.308131 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a7d0c-fd9d-4e7e-a733-c6a74f01cd25 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:54.308411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a7d0c-fd9d-4e7e-a733-c6a74f01cd25 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:54.308683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a7d0c-fd9d-4e7e-a733-c6a74f01cd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:54.328848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-eb7a7d0c-fd9d-4e7e-a733-c6a74f01cd25 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:54.329628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b2993-cf47-4e21-b619-3ff2784b39a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:54.330059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-eb7a7d0c-fd9d-4e7e-a733-c6a74f01cd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:54.330759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b2993-cf47-4e21-b619-3ff2784b39a5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:54.331429 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b2993-cf47-4e21-b619-3ff2784b39a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:54.332135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:54.332448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b2993-cf47-4e21-b619-3ff2784b39a5 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:54.334165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b2993-cf47-4e21-b619-3ff2784b39a5 None admin] RBAC: Adding query filter params (name=network) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:54.334717 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b2993-cf47-4e21-b619-3ff2784b39a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:54.336564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b2993-cf47-4e21-b619-3ff2784b39a5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:54.343419 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 353/713] 10.222.0.25 () {56 vars in 1112 bytes} [Sat Sep 24 19:18:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:54.344572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b2993-cf47-4e21-b619-3ff2784b39a5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:54.426972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 361/714] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:54.428100 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a7d0c-fd9d-4e7e-a733-c6a74f01cd25 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:54.538714 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b2993-cf47-4e21-b619-3ff2784b39a5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:54.543896 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a7d0c-fd9d-4e7e-a733-c6a74f01cd25 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:54.587193 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32675347-78ad-4c23-ae72-6715fa63f341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:54.588781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32675347-78ad-4c23-ae72-6715fa63f341 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:54.589374 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32675347-78ad-4c23-ae72-6715fa63f341 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:54.589844 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32675347-78ad-4c23-ae72-6715fa63f341 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:54.591516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32675347-78ad-4c23-ae72-6715fa63f341 None admin] RBAC: Adding query filter params (type=network) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:54.592041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32675347-78ad-4c23-ae72-6715fa63f341 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:54.594735 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32675347-78ad-4c23-ae72-6715fa63f341 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:54.606433 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 362/715] 10.222.0.25 () {56 vars in 1112 bytes} [Sat Sep 24 19:18:54 2022] GET /identity/v3/services?type=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:54.621970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4323b-b552-44fa-9d2e-c3fa57dcf356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:54.623354 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4323b-b552-44fa-9d2e-c3fa57dcf356 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:54.623839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4323b-b552-44fa-9d2e-c3fa57dcf356 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:54.624314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4323b-b552-44fa-9d2e-c3fa57dcf356 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:54.625296 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4323b-b552-44fa-9d2e-c3fa57dcf356 None admin] RBAC: Adding query filter params (role.id=dd27845a836a4f6ebece149dbebc59c0, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=4e5798be0fa544cf9cf48558e87fcfa9) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:54.625820 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4323b-b552-44fa-9d2e-c3fa57dcf356 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:54.627541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4323b-b552-44fa-9d2e-c3fa57dcf356 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:54.639986 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 354/716] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:18:54 2022] GET /identity/v3/role_assignments?user.id=4e5798be0fa544cf9cf48558e87fcfa9&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=dd27845a836a4f6ebece149dbebc59c0 => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:54.849004 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32675347-78ad-4c23-ae72-6715fa63f341 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:54.852327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:54.980521 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32675347-78ad-4c23-ae72-6715fa63f341 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:55.022204 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136139a6-09f8-4210-a44c-6e468a424955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:55.023276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136139a6-09f8-4210-a44c-6e468a424955 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:55.024053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136139a6-09f8-4210-a44c-6e468a424955 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:55.024802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136139a6-09f8-4210-a44c-6e468a424955 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:55.025591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136139a6-09f8-4210-a44c-6e468a424955 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:55.027208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136139a6-09f8-4210-a44c-6e468a424955 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:55.039155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-136139a6-09f8-4210-a44c-6e468a424955 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:18:55.039155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:55.039155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:18:55.039155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:18:55.039155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:18:55.039155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:18:55.039155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:18:55.039155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:18:55.039155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:18:55.039155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:55.039155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:18:55.039155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:55.039155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:55.039155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:55.039155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:55.039155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:55.039155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:55.040206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:55.040206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:55.040206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:55.040206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:55.040206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:55.040206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:55.040206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:18:55.040206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:18:55.040206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:18:55.040206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:18:55.040206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:55.040206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:55.040206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:55.040206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:55.040206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:55.040206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:55.041162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:55.041162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:55.041162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:55.041162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:55.041162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:55.041162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:55.041162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:55.041162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:55.041162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:55.041162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:55.041162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:18:55.041162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:18:55.041162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:18:55.041162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:55.044003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 363/717] 10.222.0.25 () {56 vars in 1129 bytes} [Sat Sep 24 19:18:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:55.050048 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4323b-b552-44fa-9d2e-c3fa57dcf356 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:55.114453 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:55.190608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4323b-b552-44fa-9d2e-c3fa57dcf356 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:55.240853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd962d-154c-4c6a-be1c-605d05a27029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:55.241468 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd962d-154c-4c6a-be1c-605d05a27029 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:55.241747 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd962d-154c-4c6a-be1c-605d05a27029 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:55.242014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd962d-154c-4c6a-be1c-605d05a27029 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:55.242641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd962d-154c-4c6a-be1c-605d05a27029 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:55.242970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd962d-154c-4c6a-be1c-605d05a27029 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:55.245157 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd962d-154c-4c6a-be1c-605d05a27029 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:55.254950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 355/718] 10.222.0.25 () {56 vars in 1124 bytes} [Sat Sep 24 19:18:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:55.260346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136139a6-09f8-4210-a44c-6e468a424955 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:55.359155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:55.439324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136139a6-09f8-4210-a44c-6e468a424955 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:55.502364 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a4940-e52e-4ba0-94ee-8b2c8481bcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:55.503007 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a4940-e52e-4ba0-94ee-8b2c8481bcf0 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:55.503291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a4940-e52e-4ba0-94ee-8b2c8481bcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:55.503563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a4940-e52e-4ba0-94ee-8b2c8481bcf0 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:55.504189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a4940-e52e-4ba0-94ee-8b2c8481bcf0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:55.504490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a4940-e52e-4ba0-94ee-8b2c8481bcf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:55.505857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a4940-e52e-4ba0-94ee-8b2c8481bcf0 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:55.514443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 364/719] 10.222.0.25 () {56 vars in 1124 bytes} [Sat Sep 24 19:18:55 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:55.941091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4a5fa-c21e-45c8-86f0-7aa2323f411e None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:55.941643 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4a5fa-c21e-45c8-86f0-7aa2323f411e None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:55.941643 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4a5fa-c21e-45c8-86f0-7aa2323f411e None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:55.943239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 356/720] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:55.949064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac520a-cb32-4223-80a5-6957c09197db None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:55.949503 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac520a-cb32-4223-80a5-6957c09197db None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:55.949677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac520a-cb32-4223-80a5-6957c09197db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:55.975807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-19ac520a-cb32-4223-80a5-6957c09197db None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:55.977016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-19ac520a-cb32-4223-80a5-6957c09197db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:56.068725 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 365/721] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:56.210914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db9b93-84b5-4fde-ac3a-cdfcf21a2c96 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:56.211105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db9b93-84b5-4fde-ac3a-cdfcf21a2c96 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:56.211441 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db9b93-84b5-4fde-ac3a-cdfcf21a2c96 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:56.213160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 357/722] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:56.218178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c1e44-78a8-41b3-8165-e01f004ca081 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:56.218465 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c1e44-78a8-41b3-8165-e01f004ca081 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:56.218744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c1e44-78a8-41b3-8165-e01f004ca081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:56.245287 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-7a3c1e44-78a8-41b3-8165-e01f004ca081 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:56.246623 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7a3c1e44-78a8-41b3-8165-e01f004ca081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:56.309766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:56.328458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 366/723] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:56.620197 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db9b93-84b5-4fde-ac3a-cdfcf21a2c96 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:56.682601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c1e44-78a8-41b3-8165-e01f004ca081 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:56.775072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db9b93-84b5-4fde-ac3a-cdfcf21a2c96 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:56.787623 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:56.855724 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed2a86-781a-45a7-8cb5-f732a1828c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:56.856390 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed2a86-781a-45a7-8cb5-f732a1828c9b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:56.856679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed2a86-781a-45a7-8cb5-f732a1828c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:56.856955 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed2a86-781a-45a7-8cb5-f732a1828c9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:56.861290 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c1e44-78a8-41b3-8165-e01f004ca081 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:56.885845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed2a86-781a-45a7-8cb5-f732a1828c9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:56.893332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-eaed2a86-781a-45a7-8cb5-f732a1828c9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:18:56.893332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:56.893332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:56.893332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:56.893332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:56.893332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:56.893332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:56.893332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:56.893332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:56.893332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:56.893332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:56.893332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:56.893332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:56.893332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:56.893332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:56.893332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:56.894260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:56.894260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:56.894260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:56.894260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:56.894260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:56.894260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:56.894260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:56.894260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:56.894260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:56.894260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:56.894260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:56.894260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:56.894260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:56.894260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:56.894260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:56.894260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:56.895155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:56.895155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:56.895155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:56.895155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:56.895155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:56.895155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:56.895155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:56.895155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:56.895155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:56.895155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:56.895155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:18:56.895155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:56.903284 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 358/724] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:18:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:56.911474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed2a86-781a-45a7-8cb5-f732a1828c9b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:56.938108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954430b-1739-462d-8547-05dba660fa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:56.938790 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954430b-1739-462d-8547-05dba660fa63 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:56.939097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954430b-1739-462d-8547-05dba660fa63 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:56.939362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954430b-1739-462d-8547-05dba660fa63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:56.963587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954430b-1739-462d-8547-05dba660fa63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:56.968416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-8954430b-1739-462d-8547-05dba660fa63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:56.968416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:56.968416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:56.968416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:56.968416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:56.968416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:56.968416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:56.968416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:56.968416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:56.968416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:56.968416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:56.968416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:56.968416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:56.968416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:56.968416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:56.968416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:56.970647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:56.970647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:56.970647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:56.970647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:56.970647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:56.970647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:56.970647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:56.970647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:56.970647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:56.970647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:56.970647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:56.970647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:56.970647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:56.970647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:56.970647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:56.970647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:56.972686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:56.972686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:56.972686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:56.972686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:56.972686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:56.972686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:56.972686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:56.972686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:56.972686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:56.972686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:56.972686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:18:56.972686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:56.972686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 367/725] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:18:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:56.981986 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954430b-1739-462d-8547-05dba660fa63 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:57.091797 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:57.125825 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed2a86-781a-45a7-8cb5-f732a1828c9b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:57.187674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954430b-1739-462d-8547-05dba660fa63 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:57.198228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a267a46-9362-454b-b5dc-fedb30f923c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:57.198855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a267a46-9362-454b-b5dc-fedb30f923c0 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:57.199137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a267a46-9362-454b-b5dc-fedb30f923c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:57.199400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a267a46-9362-454b-b5dc-fedb30f923c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:57.200061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a267a46-9362-454b-b5dc-fedb30f923c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:57.200356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a267a46-9362-454b-b5dc-fedb30f923c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:57.201700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a267a46-9362-454b-b5dc-fedb30f923c0 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:57.217438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 359/726] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:57.224395 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a267a46-9362-454b-b5dc-fedb30f923c0 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:57.268374 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe55b3-df47-42dc-97ba-eebe9c49fbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:57.269020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe55b3-df47-42dc-97ba-eebe9c49fbf7 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:57.269300 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe55b3-df47-42dc-97ba-eebe9c49fbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:57.269574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe55b3-df47-42dc-97ba-eebe9c49fbf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:57.269996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:57.270258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe55b3-df47-42dc-97ba-eebe9c49fbf7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:57.270562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe55b3-df47-42dc-97ba-eebe9c49fbf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:57.272031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe55b3-df47-42dc-97ba-eebe9c49fbf7 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:57.289593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 368/727] 10.222.0.25 () {56 vars in 1103 bytes} [Sat Sep 24 19:18:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:18:57.295879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe55b3-df47-42dc-97ba-eebe9c49fbf7 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:57.346763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a267a46-9362-454b-b5dc-fedb30f923c0 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:57.382854 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ee46d-2fe4-4430-9c7d-035143ad3fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:57.383838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ee46d-2fe4-4430-9c7d-035143ad3fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:57.384165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ee46d-2fe4-4430-9c7d-035143ad3fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:57.384435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ee46d-2fe4-4430-9c7d-035143ad3fb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:57.395380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ee46d-2fe4-4430-9c7d-035143ad3fb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:57.397020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ee46d-2fe4-4430-9c7d-035143ad3fb3 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:57.411381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-363ee46d-2fe4-4430-9c7d-035143ad3fb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:57.411381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:57.411381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:57.411381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:57.411381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:57.411381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:57.411381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:57.411381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:57.411381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:57.411381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:57.411381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:57.411381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:57.411381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:57.411381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:57.411381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:57.411381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:57.412380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:57.412380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:57.412380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:57.412380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:57.412380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:57.412380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:57.412380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:57.412380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:57.412380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:57.412380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:57.412380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:57.412380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:57.412380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:57.412380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:57.412380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:57.412380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:57.412380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:57.413312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:57.413312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:57.413312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:57.413312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 360/728] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:57.413839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d18488-a2e8-476e-8641-3876b46f25ad None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:57.413839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d18488-a2e8-476e-8641-3876b46f25ad None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:57.414127 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d18488-a2e8-476e-8641-3876b46f25ad None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:57.415760 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 361/729] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:57.417097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78b7e9-0e87-44fd-8cb3-fb54127bfaae None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:57.417228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78b7e9-0e87-44fd-8cb3-fb54127bfaae None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:57.417478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78b7e9-0e87-44fd-8cb3-fb54127bfaae None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:57.418917 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 362/730] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:57.420033 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78b7e9-0e87-44fd-8cb3-fb54127bfaae None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:57.445355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe55b3-df47-42dc-97ba-eebe9c49fbf7 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:57.458985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:57.482240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94370ebe-edd9-4aec-9e31-ce30c51a12c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:57.482886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94370ebe-edd9-4aec-9e31-ce30c51a12c8 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:57.483168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94370ebe-edd9-4aec-9e31-ce30c51a12c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:57.483447 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94370ebe-edd9-4aec-9e31-ce30c51a12c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:57.495041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94370ebe-edd9-4aec-9e31-ce30c51a12c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:57.496493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94370ebe-edd9-4aec-9e31-ce30c51a12c8 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:57.507181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:57.512303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-94370ebe-edd9-4aec-9e31-ce30c51a12c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:57.512303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:57.512303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:57.512303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:57.512303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:57.512303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:57.512303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:57.512303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:57.512303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:57.512303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:57.512303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:57.512303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:57.512303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:57.512303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:57.512303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:57.512303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:57.513262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:57.513262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:57.513262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:57.513262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:57.513262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:57.513262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:57.513262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:57.513262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:57.513262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:57.513262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:57.513262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:57.513262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:57.513262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:57.513262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:57.513262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:57.513262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:57.513262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:57.514147 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:57.514147 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:57.514147 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:57.514147 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 369/731] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:57.514670 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c0a37-e7ef-44a9-8913-62925f4439c9 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:57.514857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c0a37-e7ef-44a9-8913-62925f4439c9 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:57.515137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c0a37-e7ef-44a9-8913-62925f4439c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:57.533896 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78b7e9-0e87-44fd-8cb3-fb54127bfaae None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:57.534082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-354c0a37-e7ef-44a9-8913-62925f4439c9 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:57.535144 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-354c0a37-e7ef-44a9-8913-62925f4439c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:57.573246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac57ff-0b96-47a6-871a-fa33412f888b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:57.573860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac57ff-0b96-47a6-871a-fa33412f888b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:57.574138 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac57ff-0b96-47a6-871a-fa33412f888b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:57.574411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac57ff-0b96-47a6-871a-fa33412f888b None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:57.575149 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac57ff-0b96-47a6-871a-fa33412f888b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:57.575458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac57ff-0b96-47a6-871a-fa33412f888b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:57.576880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac57ff-0b96-47a6-871a-fa33412f888b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:57.594442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 363/732] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:57.594442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a8e1e-125c-4415-a862-8b539adb9b13 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:57.594442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a8e1e-125c-4415-a862-8b539adb9b13 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:57.594442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a8e1e-125c-4415-a862-8b539adb9b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:57.610375 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 370/733] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:57.611513 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c0a37-e7ef-44a9-8913-62925f4439c9 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:57.620552 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-c80a8e1e-125c-4415-a862-8b539adb9b13 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:57.621764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c80a8e1e-125c-4415-a862-8b539adb9b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:57.701444 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 364/734] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:57.702259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a8e1e-125c-4415-a862-8b539adb9b13 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:57.731274 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:57.739849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c0a37-e7ef-44a9-8913-62925f4439c9 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:57.781219 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:57.787702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693fd2e-9a0a-41af-bd45-3b68b04e546b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:57.787702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693fd2e-9a0a-41af-bd45-3b68b04e546b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:57.787702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693fd2e-9a0a-41af-bd45-3b68b04e546b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:57.787702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693fd2e-9a0a-41af-bd45-3b68b04e546b None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:57.788083 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693fd2e-9a0a-41af-bd45-3b68b04e546b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:57.788083 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693fd2e-9a0a-41af-bd45-3b68b04e546b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:57.788083 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693fd2e-9a0a-41af-bd45-3b68b04e546b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:57.800551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 371/735] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:57.808813 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693fd2e-9a0a-41af-bd45-3b68b04e546b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:57.846799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a8e1e-125c-4415-a862-8b539adb9b13 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:57.926503 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c5ccc-c054-4774-927b-9950b9682a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:57.927454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c5ccc-c054-4774-927b-9950b9682a6e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:57.927906 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c5ccc-c054-4774-927b-9950b9682a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:57.928378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c5ccc-c054-4774-927b-9950b9682a6e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:57.938686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c5ccc-c054-4774-927b-9950b9682a6e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:57.940424 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c5ccc-c054-4774-927b-9950b9682a6e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:57.957981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-f05c5ccc-c054-4774-927b-9950b9682a6e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:18:57.957981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:57.957981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:57.957981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:57.957981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:57.957981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:57.957981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:57.957981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:57.957981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:57.957981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:57.957981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:57.957981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:57.957981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:18:57.957981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:18:57.957981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:18:57.957981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:18:57.958970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:57.958970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:57.958970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:18:57.958970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:57.958970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:18:57.958970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:57.958970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:57.958970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:57.958970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:57.958970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:57.958970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:57.958970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:57.958970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:57.958970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:57.958970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:57.958970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:57.958970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:57.958970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:57.960000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:57.960000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:57.960000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:18:57.960000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:18:57.960000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:18:57.960000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:18:57.960000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:18:57.960000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:18:57.960000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:18:57.960000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:57.960000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 365/736] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:18:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:57.960581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c5ccc-c054-4774-927b-9950b9682a6e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:57.971717 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693fd2e-9a0a-41af-bd45-3b68b04e546b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:58.014410 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37b71d-e4d3-4a2d-8a91-2c2061517e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:58.015441 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37b71d-e4d3-4a2d-8a91-2c2061517e51 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:58.015923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37b71d-e4d3-4a2d-8a91-2c2061517e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:58.016362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37b71d-e4d3-4a2d-8a91-2c2061517e51 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:58.027925 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37b71d-e4d3-4a2d-8a91-2c2061517e51 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:58.030536 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37b71d-e4d3-4a2d-8a91-2c2061517e51 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:58.046741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-cc37b71d-e4d3-4a2d-8a91-2c2061517e51 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:18:58.046741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:58.046741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:58.046741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:58.046741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:58.046741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:58.046741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:58.046741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:58.046741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:58.046741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:58.046741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:58.046741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:58.046741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:18:58.046741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:18:58.046741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:18:58.046741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:18:58.047903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:58.047903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:58.047903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:18:58.047903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:58.047903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:18:58.047903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:58.047903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:58.047903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:58.047903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:58.047903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:58.047903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:58.047903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:58.047903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:58.047903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:58.047903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:58.047903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:58.047903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:58.047903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:58.048876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:58.048876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:58.048876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:18:58.048876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:18:58.048876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:18:58.048876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:18:58.048876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:18:58.048876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:18:58.048876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:18:58.048876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:58.052506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 372/737] 10.222.0.25 () {56 vars in 1117 bytes} [Sat Sep 24 19:18:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:58.058155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37b71d-e4d3-4a2d-8a91-2c2061517e51 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:58.078366 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:58.084221 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c5ccc-c054-4774-927b-9950b9682a6e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:58.113709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:58.120651 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763e755-84e9-4648-80e5-97ea0b32aca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:58.121279 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763e755-84e9-4648-80e5-97ea0b32aca7 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:58.121554 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763e755-84e9-4648-80e5-97ea0b32aca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:58.121820 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763e755-84e9-4648-80e5-97ea0b32aca7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:58.132722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763e755-84e9-4648-80e5-97ea0b32aca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:18:58.138312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-3763e755-84e9-4648-80e5-97ea0b32aca7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:18:58.138312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:58.138312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:58.138312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:58.138312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:58.138312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:58.138312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:58.138312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:58.138312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:58.138312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:58.138312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:58.138312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:58.138312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:18:58.138312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:18:58.138312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:18:58.138312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:18:58.139271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:18:58.139271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:18:58.139271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:18:58.139271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:18:58.139271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:58.139271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:58.139271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:58.139271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:58.139271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:58.139271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:58.139271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:58.139271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:58.139271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:58.139271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:58.139271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:58.139271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:58.140135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:58.140135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:58.140135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:58.140135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:58.140135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:18:58.140135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:18:58.140135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:18:58.140135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:18:58.140135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:18:58.140135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:18:58.140135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:18:58.140135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:58.144247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 366/738] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:18:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:58.144972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763e755-84e9-4648-80e5-97ea0b32aca7 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:58.172278 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37b71d-e4d3-4a2d-8a91-2c2061517e51 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:58.204876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2dfa39-29bd-4fe1-bdbc-151a7405cec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:58.205476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dfa39-29bd-4fe1-bdbc-151a7405cec2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:58.205751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dfa39-29bd-4fe1-bdbc-151a7405cec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:58.206018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dfa39-29bd-4fe1-bdbc-151a7405cec2 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:58.206729 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2dfa39-29bd-4fe1-bdbc-151a7405cec2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:58.207069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2dfa39-29bd-4fe1-bdbc-151a7405cec2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:58.208548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2dfa39-29bd-4fe1-bdbc-151a7405cec2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:58.225671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 373/739] 10.222.0.25 () {56 vars in 1135 bytes} [Sat Sep 24 19:18:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:58.226446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2dfa39-29bd-4fe1-bdbc-151a7405cec2 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:58.245419 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763e755-84e9-4648-80e5-97ea0b32aca7 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:58.278555 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336e1f1-8a0a-4c52-a96f-5ff7ebe7f920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:58.279183 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336e1f1-8a0a-4c52-a96f-5ff7ebe7f920 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:58.279459 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336e1f1-8a0a-4c52-a96f-5ff7ebe7f920 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:58.279728 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336e1f1-8a0a-4c52-a96f-5ff7ebe7f920 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:58.280446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336e1f1-8a0a-4c52-a96f-5ff7ebe7f920 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:58.280750 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336e1f1-8a0a-4c52-a96f-5ff7ebe7f920 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:58.282172 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336e1f1-8a0a-4c52-a96f-5ff7ebe7f920 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:58.298308 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:58.299555 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 367/740] 10.222.0.25 () {56 vars in 1149 bytes} [Sat Sep 24 19:18:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:58.300757 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab240a-934d-4539-a176-e1bcafad4441 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:58.301041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab240a-934d-4539-a176-e1bcafad4441 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:58.301314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab240a-934d-4539-a176-e1bcafad4441 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:58.302692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 368/741] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:18:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:18:58.303219 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab240a-934d-4539-a176-e1bcafad4441 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:58.333406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2dfa39-29bd-4fe1-bdbc-151a7405cec2 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:58.353977 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:58.367504 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b401be-a5ff-4513-b5a5-ff0c9d362c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:58.368102 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b401be-a5ff-4513-b5a5-ff0c9d362c79 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:58.368416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b401be-a5ff-4513-b5a5-ff0c9d362c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:58.368691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b401be-a5ff-4513-b5a5-ff0c9d362c79 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:58.369325 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b401be-a5ff-4513-b5a5-ff0c9d362c79 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:58.370674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b401be-a5ff-4513-b5a5-ff0c9d362c79 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:58.386630 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 374/742] 10.222.0.25 () {60 vars in 1141 bytes} [Sat Sep 24 19:18:58 2022] POST /identity/v3/services => generated 240 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:18:58.387491 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b401be-a5ff-4513-b5a5-ff0c9d362c79 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:58.432756 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab240a-934d-4539-a176-e1bcafad4441 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:58.473581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39451202-089e-4ca5-a08c-be24498eddbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:58.474127 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39451202-089e-4ca5-a08c-be24498eddbe None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:58.474395 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39451202-089e-4ca5-a08c-be24498eddbe None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:58.474664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39451202-089e-4ca5-a08c-be24498eddbe None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:58.475369 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39451202-089e-4ca5-a08c-be24498eddbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:58.475671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39451202-089e-4ca5-a08c-be24498eddbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:58.477228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39451202-089e-4ca5-a08c-be24498eddbe None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:58.492137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 369/743] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:18:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:58.492137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39451202-089e-4ca5-a08c-be24498eddbe None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:58.509605 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b401be-a5ff-4513-b5a5-ff0c9d362c79 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:58.543888 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:58.550685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8a902-1107-4306-8366-8d16e6c463d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:58.551857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8a902-1107-4306-8366-8d16e6c463d9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:58.552290 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8a902-1107-4306-8366-8d16e6c463d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:58.552946 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8a902-1107-4306-8366-8d16e6c463d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:58.612024 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39451202-089e-4ca5-a08c-be24498eddbe None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:58.619363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:58.634112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8a902-1107-4306-8366-8d16e6c463d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:58.635580 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8a902-1107-4306-8366-8d16e6c463d9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:58.647575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af369517-3b4d-4d9a-b5a3-9ef307b13824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:58.648188 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af369517-3b4d-4d9a-b5a3-9ef307b13824 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:58.648467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af369517-3b4d-4d9a-b5a3-9ef307b13824 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:58.648994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af369517-3b4d-4d9a-b5a3-9ef307b13824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:58.721475 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af369517-3b4d-4d9a-b5a3-9ef307b13824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:58.722960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af369517-3b4d-4d9a-b5a3-9ef307b13824 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:58.758625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 375/744] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:58 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:18:58.760004 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d95596-27ec-4b42-a998-0990e957e0b2 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:58.760282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d95596-27ec-4b42-a998-0990e957e0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:58.760794 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d95596-27ec-4b42-a998-0990e957e0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:58.779952 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-47d95596-27ec-4b42-a998-0990e957e0b2 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:18:58.781499 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-47d95596-27ec-4b42-a998-0990e957e0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:18:58.811089 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:58.837726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 370/745] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:18:58 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:18:58.837726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af369517-3b4d-4d9a-b5a3-9ef307b13824 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:58.844922 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:58.863812 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 376/746] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:18:58 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:18:58.864521 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d95596-27ec-4b42-a998-0990e957e0b2 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:58.949116 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af369517-3b4d-4d9a-b5a3-9ef307b13824 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:58.985355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d95596-27ec-4b42-a998-0990e957e0b2 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:58.987219 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d326370-b519-4fc8-bd9d-e57ff01cb2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:58.987913 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d326370-b519-4fc8-bd9d-e57ff01cb2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:58.988191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d326370-b519-4fc8-bd9d-e57ff01cb2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:58.988456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d326370-b519-4fc8-bd9d-e57ff01cb2b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:58.999086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d326370-b519-4fc8-bd9d-e57ff01cb2b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:59.000529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d326370-b519-4fc8-bd9d-e57ff01cb2b1 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:59.018233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-4d326370-b519-4fc8-bd9d-e57ff01cb2b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:59.018233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:59.018233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:59.018233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:59.018233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:59.018233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:59.018233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:59.018233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:59.018233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:59.018233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:59.018233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:59.018233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:59.018233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:59.018233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:59.018233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:59.018233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:59.019531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:59.019531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:59.019531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:59.019531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:59.019531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:59.019531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:59.019531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:59.019531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:59.019531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:59.019531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:59.019531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:59.019531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:59.019531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:59.019531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:59.019531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:59.019531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:59.019531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:59.021356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:59.021356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:59.021356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:59.021356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 371/747] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:59.021356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d326370-b519-4fc8-bd9d-e57ff01cb2b1 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:59.031010 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be39040-3801-4951-a2f4-7e799f82fad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:59.031643 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be39040-3801-4951-a2f4-7e799f82fad0 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:59.031914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be39040-3801-4951-a2f4-7e799f82fad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:59.032180 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be39040-3801-4951-a2f4-7e799f82fad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:59.046674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be39040-3801-4951-a2f4-7e799f82fad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:59.048745 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be39040-3801-4951-a2f4-7e799f82fad0 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:59.069523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-8be39040-3801-4951-a2f4-7e799f82fad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:59.069523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:59.069523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:59.069523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:59.069523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:59.069523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:59.069523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:59.069523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:59.069523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:59.069523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:59.069523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:59.069523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:59.069523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:59.069523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:59.069523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:59.069523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:59.071094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:59.071094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:59.071094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:59.071094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:59.071094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:59.071094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:59.071094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:59.071094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:59.071094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:59.071094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:59.071094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:59.071094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:59.071094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:59.071094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:59.071094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:59.071094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:59.071094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:59.073060 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:59.073060 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:59.073060 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:59.073060 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 377/748] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:59.073060 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be39040-3801-4951-a2f4-7e799f82fad0 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:59.094055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:59.099958 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:59.158980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d326370-b519-4fc8-bd9d-e57ff01cb2b1 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:59.195796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832735f3-5b06-4919-8adb-dfac53a30437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:59.196973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832735f3-5b06-4919-8adb-dfac53a30437 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:59.197399 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832735f3-5b06-4919-8adb-dfac53a30437 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:59.197686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832735f3-5b06-4919-8adb-dfac53a30437 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:59.208661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832735f3-5b06-4919-8adb-dfac53a30437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:59.210099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832735f3-5b06-4919-8adb-dfac53a30437 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:59.213453 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be39040-3801-4951-a2f4-7e799f82fad0 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:59.225405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-832735f3-5b06-4919-8adb-dfac53a30437 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:59.225405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:59.225405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:59.225405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:59.225405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:59.225405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:59.225405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:59.225405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:59.225405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:59.225405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:59.225405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:59.225405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:59.225405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:18:59.225405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:18:59.225405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:18:59.225405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:18:59.226597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:59.226597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:59.226597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:59.226597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:59.226597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:59.226597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:59.226597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:59.226597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:59.226597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:59.226597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:59.226597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:59.226597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:59.226597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:59.226597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:59.226597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:59.226597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:59.226597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:18:59.227767 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:18:59.227767 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:18:59.227767 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:59.229146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 372/749] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:18:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:59.230054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832735f3-5b06-4919-8adb-dfac53a30437 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:59.255726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc708b-da0f-431b-ac63-ed4601a61f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:59.256333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc708b-da0f-431b-ac63-ed4601a61f9f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:59.256601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc708b-da0f-431b-ac63-ed4601a61f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:59.256868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc708b-da0f-431b-ac63-ed4601a61f9f None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:59.257493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc708b-da0f-431b-ac63-ed4601a61f9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:59.257790 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc708b-da0f-431b-ac63-ed4601a61f9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:59.259932 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc708b-da0f-431b-ac63-ed4601a61f9f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:59.272650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 378/750] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:59.273212 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc708b-da0f-431b-ac63-ed4601a61f9f None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:59.354229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832735f3-5b06-4919-8adb-dfac53a30437 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:59.367563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:59.382337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:59.394013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31471ea5-8466-4dfa-bfbd-aac02be522b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:59.394600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31471ea5-8466-4dfa-bfbd-aac02be522b5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:59.394901 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31471ea5-8466-4dfa-bfbd-aac02be522b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:59.395176 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31471ea5-8466-4dfa-bfbd-aac02be522b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:59.395817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31471ea5-8466-4dfa-bfbd-aac02be522b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:59.396120 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31471ea5-8466-4dfa-bfbd-aac02be522b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:59.398456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31471ea5-8466-4dfa-bfbd-aac02be522b5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:59.417728 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc708b-da0f-431b-ac63-ed4601a61f9f None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:59.419009 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 373/751] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:59.419913 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31471ea5-8466-4dfa-bfbd-aac02be522b5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:59.462675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c88cd-9292-459a-b549-161785713baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:59.463685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c88cd-9292-459a-b549-161785713baf None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:59.463984 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c88cd-9292-459a-b549-161785713baf None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:59.464253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c88cd-9292-459a-b549-161785713baf None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:59.465145 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c88cd-9292-459a-b549-161785713baf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:59.467730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c88cd-9292-459a-b549-161785713baf None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:59.494864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 379/752] 10.222.0.25 () {60 vars in 1141 bytes} [Sat Sep 24 19:18:59 2022] POST /identity/v3/services => generated 251 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:18:59.494864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c88cd-9292-459a-b549-161785713baf None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:59.566980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31471ea5-8466-4dfa-bfbd-aac02be522b5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:59.620763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec7f29-14ea-4f7b-904d-b4657942fc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:59.621801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec7f29-14ea-4f7b-904d-b4657942fc33 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:59.622260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec7f29-14ea-4f7b-904d-b4657942fc33 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:59.622726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec7f29-14ea-4f7b-904d-b4657942fc33 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:59.623706 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec7f29-14ea-4f7b-904d-b4657942fc33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:18:59.624014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec7f29-14ea-4f7b-904d-b4657942fc33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:59.625451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec7f29-14ea-4f7b-904d-b4657942fc33 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:59.629806 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c88cd-9292-459a-b549-161785713baf None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:59.640722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 374/753] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:18:59.641689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec7f29-14ea-4f7b-904d-b4657942fc33 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:59.684199 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ed5f8-c1c9-421e-be03-ea0a2af8b8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:59.684858 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ed5f8-c1c9-421e-be03-ea0a2af8b8be None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:59.685142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ed5f8-c1c9-421e-be03-ea0a2af8b8be None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:59.685559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ed5f8-c1c9-421e-be03-ea0a2af8b8be None admin] PATH_INFO: `/v3/users/nova` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:59.689552 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:59.690081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:59.696429 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ed5f8-c1c9-421e-be03-ea0a2af8b8be None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:59.698046 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ed5f8-c1c9-421e-be03-ea0a2af8b8be None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:59.714798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-6a5ed5f8-c1c9-421e-be03-ea0a2af8b8be None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:18:59.714798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:59.714798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:59.714798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:59.714798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:59.714798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:59.714798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:59.714798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:59.714798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:59.714798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:59.714798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:59.714798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:59.714798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:18:59.714798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:18:59.714798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:18:59.714798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:18:59.715868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:59.715868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:59.715868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:18:59.715868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:59.715868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:18:59.715868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:18:59.715868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:59.715868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:59.715868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:59.715868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:59.715868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:59.715868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:59.715868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:59.715868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:59.715868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:59.715868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:59.715868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:59.715868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:59.716807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:59.716807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:59.716807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:18:59.716807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:18:59.716807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:18:59.716807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:18:59.716807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:18:59.716807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:18:59.716807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:18:59.716807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:59.716807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 380/754] 10.222.0.25 () {56 vars in 1093 bytes} [Sat Sep 24 19:18:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:59.717397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ed5f8-c1c9-421e-be03-ea0a2af8b8be None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:59.796295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec7f29-14ea-4f7b-904d-b4657942fc33 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:59.832973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85541b2-3a40-473c-9dd6-b8557cd71090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:59.833967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85541b2-3a40-473c-9dd6-b8557cd71090 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:59.834476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85541b2-3a40-473c-9dd6-b8557cd71090 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:59.834985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85541b2-3a40-473c-9dd6-b8557cd71090 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:59.843599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85541b2-3a40-473c-9dd6-b8557cd71090 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:59.845320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85541b2-3a40-473c-9dd6-b8557cd71090 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:59.857140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ed5f8-c1c9-421e-be03-ea0a2af8b8be None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:18:59.858139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-a85541b2-3a40-473c-9dd6-b8557cd71090 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:59.858139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:59.858139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:59.858139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:59.858139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:59.858139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:59.858139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:59.858139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:59.858139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:59.858139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:59.858139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:59.858139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:59.858139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:18:59.858139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:18:59.858139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:18:59.859066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:18:59.859066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:59.859066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:59.859066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:59.859066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:59.859066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:59.859066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:59.859066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:59.859066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:59.859066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:59.859066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:59.859066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:59.859066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:59.859066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:59.859066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:59.859066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:59.859066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:59.860032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:18:59.860032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:18:59.860032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:18:59.860032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:18:59.860032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:18:59.860032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:18:59.860032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:59.860032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:18:59.862400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 375/755] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:59.863575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85541b2-3a40-473c-9dd6-b8557cd71090 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:59.902960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f4b54-b1c7-4830-827a-fccdb9a270e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:18:59.904004 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f4b54-b1c7-4830-827a-fccdb9a270e0 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:18:59.904521 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f4b54-b1c7-4830-827a-fccdb9a270e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:18:59.905012 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f4b54-b1c7-4830-827a-fccdb9a270e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:18:59.913162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f4b54-b1c7-4830-827a-fccdb9a270e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:18:59.914949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f4b54-b1c7-4830-827a-fccdb9a270e0 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:18:59.928965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-477f4b54-b1c7-4830-827a-fccdb9a270e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:59.928965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:18:59.928965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:18:59.928965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:18:59.928965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:18:59.928965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:18:59.928965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:18:59.928965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:18:59.928965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:18:59.928965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:18:59.928965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:18:59.928965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:18:59.928965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:18:59.928965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:18:59.928965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:18:59.929949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:18:59.929949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:18:59.929949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:18:59.929949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:18:59.929949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:18:59.929949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:18:59.929949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:18:59.929949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:18:59.929949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:18:59.929949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:18:59.929949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:18:59.929949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:18:59.929949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:18:59.929949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:18:59.929949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:18:59.929949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:18:59.929949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:18:59.931560 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:18:59.931560 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:18:59.931560 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:18:59.931560 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:18:59.931560 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:18:59.931560 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:18:59.931560 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:18:59.931560 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:18:59.932672 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 381/756] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:18:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:18:59.933368 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f4b54-b1c7-4830-827a-fccdb9a270e0 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:18:59.971218 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:18:59.991521 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85541b2-3a40-473c-9dd6-b8557cd71090 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:00.000377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:00.033891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9aee1b-58f8-43ee-834b-fb6e99bd547d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:00.034967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aee1b-58f8-43ee-834b-fb6e99bd547d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:00.035451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aee1b-58f8-43ee-834b-fb6e99bd547d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:00.035943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aee1b-58f8-43ee-834b-fb6e99bd547d None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:00.036993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9aee1b-58f8-43ee-834b-fb6e99bd547d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:00.037543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9aee1b-58f8-43ee-834b-fb6e99bd547d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:00.039273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9aee1b-58f8-43ee-834b-fb6e99bd547d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:00.058566 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f4b54-b1c7-4830-827a-fccdb9a270e0 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:00.067222 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 376/757] 10.222.0.25 () {56 vars in 1133 bytes} [Sat Sep 24 19:18:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:00.068414 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9aee1b-58f8-43ee-834b-fb6e99bd547d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:00.099712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dce7f-3ab8-421a-a271-5f36e8b191bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:00.100429 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dce7f-3ab8-421a-a271-5f36e8b191bf None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:00.100805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dce7f-3ab8-421a-a271-5f36e8b191bf None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:00.101157 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dce7f-3ab8-421a-a271-5f36e8b191bf None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:00.102327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5dce7f-3ab8-421a-a271-5f36e8b191bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:00.102327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5dce7f-3ab8-421a-a271-5f36e8b191bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:00.104704 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5dce7f-3ab8-421a-a271-5f36e8b191bf None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:00.121886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 382/758] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:18:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:00.122999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dce7f-3ab8-421a-a271-5f36e8b191bf None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:00.216070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9aee1b-58f8-43ee-834b-fb6e99bd547d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:00.256127 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dce7f-3ab8-421a-a271-5f36e8b191bf None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:00.257697 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa318cae-4a2b-4d60-af6a-145dc33a0734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:00.258410 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa318cae-4a2b-4d60-af6a-145dc33a0734 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:00.258783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa318cae-4a2b-4d60-af6a-145dc33a0734 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:00.259180 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa318cae-4a2b-4d60-af6a-145dc33a0734 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:00.259950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa318cae-4a2b-4d60-af6a-145dc33a0734 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:00.261025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa318cae-4a2b-4d60-af6a-145dc33a0734 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:00.261884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa318cae-4a2b-4d60-af6a-145dc33a0734 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:00.275010 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:00.275761 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 377/759] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:19:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:00.276730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa318cae-4a2b-4d60-af6a-145dc33a0734 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:00.282245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:00.310701 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed97652-72df-4266-9544-e2a1fd6b302b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:00.311868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed97652-72df-4266-9544-e2a1fd6b302b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:00.312220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed97652-72df-4266-9544-e2a1fd6b302b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:00.312565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed97652-72df-4266-9544-e2a1fd6b302b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:00.327658 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed97652-72df-4266-9544-e2a1fd6b302b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:00.332760 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed97652-72df-4266-9544-e2a1fd6b302b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:00.350860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-8ed97652-72df-4266-9544-e2a1fd6b302b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:00.350860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:00.350860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:00.350860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:00.350860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:00.350860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:00.350860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:00.350860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:00.350860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:00.350860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:00.350860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:00.350860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:00.350860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:00.350860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:00.350860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:00.350860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:00.351847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:00.351847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:00.351847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:00.351847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:00.351847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:00.351847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:00.351847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:00.351847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:00.351847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:00.351847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:00.351847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:00.351847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:00.351847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:00.351847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:00.351847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:00.351847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:00.351847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:00.352817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:00.352817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:00.352817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:00.354747 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 383/760] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:00.356001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed97652-72df-4266-9544-e2a1fd6b302b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:00.402867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa318cae-4a2b-4d60-af6a-145dc33a0734 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:00.451478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35e5a7-60ec-416c-95c5-d2b8eed7a074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:00.452242 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35e5a7-60ec-416c-95c5-d2b8eed7a074 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:00.452623 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35e5a7-60ec-416c-95c5-d2b8eed7a074 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:00.452996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35e5a7-60ec-416c-95c5-d2b8eed7a074 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:00.453971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35e5a7-60ec-416c-95c5-d2b8eed7a074 None admin] RBAC: Adding query filter params (role.id=dd27845a836a4f6ebece149dbebc59c0, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=85b45de73f7b4f7da7e0e8d8375deb37) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:00.454388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35e5a7-60ec-416c-95c5-d2b8eed7a074 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:00.456163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35e5a7-60ec-416c-95c5-d2b8eed7a074 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:00.463487 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 378/761] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:19:00 2022] GET /identity/v3/role_assignments?user.id=85b45de73f7b4f7da7e0e8d8375deb37&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=dd27845a836a4f6ebece149dbebc59c0 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:00.464443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35e5a7-60ec-416c-95c5-d2b8eed7a074 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:00.477736 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed97652-72df-4266-9544-e2a1fd6b302b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:00.528099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40531282-118d-4d49-adf6-539207a5f2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:00.528994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40531282-118d-4d49-adf6-539207a5f2c6 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:00.529593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40531282-118d-4d49-adf6-539207a5f2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:00.530128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40531282-118d-4d49-adf6-539207a5f2c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:00.531069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40531282-118d-4d49-adf6-539207a5f2c6 None admin] RBAC: Adding query filter params (role.id=a2673fe5628247c3a918eaa28d483e9f, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=7c398cf6318240f09d2c3b62bc6761d5) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:00.531611 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40531282-118d-4d49-adf6-539207a5f2c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:00.533271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40531282-118d-4d49-adf6-539207a5f2c6 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:00.541509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 384/762] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:19:00 2022] GET /identity/v3/role_assignments?user.id=7c398cf6318240f09d2c3b62bc6761d5&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=a2673fe5628247c3a918eaa28d483e9f => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:00.548694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:00.594513 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35e5a7-60ec-416c-95c5-d2b8eed7a074 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:00.642786 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64569a-7c81-4246-9b8c-7f2feafe73ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:00.643533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64569a-7c81-4246-9b8c-7f2feafe73ba None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:00.643914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64569a-7c81-4246-9b8c-7f2feafe73ba None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:00.644288 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64569a-7c81-4246-9b8c-7f2feafe73ba None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:00.645063 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64569a-7c81-4246-9b8c-7f2feafe73ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:00.645473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64569a-7c81-4246-9b8c-7f2feafe73ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:00.647063 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64569a-7c81-4246-9b8c-7f2feafe73ba None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:00.668288 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 379/763] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:00.668689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186954d4-0b35-479f-97c1-a72b7abcc578 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:00.668981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186954d4-0b35-479f-97c1-a72b7abcc578 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:00.669259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186954d4-0b35-479f-97c1-a72b7abcc578 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:00.670738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 385/764] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:00.673744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64569a-7c81-4246-9b8c-7f2feafe73ba None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:00.684549 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497cac6-39a1-4e41-bb1a-1b25764637d0 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:00.684549 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497cac6-39a1-4e41-bb1a-1b25764637d0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:00.684855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497cac6-39a1-4e41-bb1a-1b25764637d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:00.733285 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-e497cac6-39a1-4e41-bb1a-1b25764637d0 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:00.733652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e497cac6-39a1-4e41-bb1a-1b25764637d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:00.764765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:00.824527 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 386/765] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:19:00.848408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64569a-7c81-4246-9b8c-7f2feafe73ba None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:00.878253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:00.887710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c3161-f7a7-4e3b-b4f8-732f89866bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:00.888661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c3161-f7a7-4e3b-b4f8-732f89866bcd None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:00.889143 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c3161-f7a7-4e3b-b4f8-732f89866bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:00.889640 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c3161-f7a7-4e3b-b4f8-732f89866bcd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:00.897082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c3161-f7a7-4e3b-b4f8-732f89866bcd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:00.899079 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c3161-f7a7-4e3b-b4f8-732f89866bcd None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:00.911652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-a10c3161-f7a7-4e3b-b4f8-732f89866bcd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:00.911652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:00.911652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:00.911652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:00.911652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:00.911652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:00.911652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:00.911652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:00.911652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:00.911652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:00.911652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:00.911652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:00.911652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:19:00.911652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:19:00.911652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:19:00.912571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:19:00.912571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:00.912571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:00.912571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:00.912571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:00.912571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:00.912571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:00.912571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:00.912571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:00.912571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:00.912571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:00.912571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:00.912571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:00.912571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:00.912571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:00.912571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:00.912571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:00.913553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:19:00.913553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:19:00.913553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:19:00.913553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:19:00.913553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:19:00.913553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:19:00.913553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:00.913553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:00.916225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 380/766] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:19:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:00.922873 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497cac6-39a1-4e41-bb1a-1b25764637d0 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:01.075658 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497cac6-39a1-4e41-bb1a-1b25764637d0 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:01.113648 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a3895-b05e-48ce-98ae-47cebfbcc5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:01.114255 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a3895-b05e-48ce-98ae-47cebfbcc5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:01.114531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a3895-b05e-48ce-98ae-47cebfbcc5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:01.114796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a3895-b05e-48ce-98ae-47cebfbcc5b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:01.115514 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a3895-b05e-48ce-98ae-47cebfbcc5b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:01.115814 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a3895-b05e-48ce-98ae-47cebfbcc5b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:01.117216 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a3895-b05e-48ce-98ae-47cebfbcc5b5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:01.129529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 387/767] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:19:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:01.135146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c3161-f7a7-4e3b-b4f8-732f89866bcd None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:01.164101 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a3895-b05e-48ce-98ae-47cebfbcc5b5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:01.189908 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:01.292921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a3895-b05e-48ce-98ae-47cebfbcc5b5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:01.321261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c3161-f7a7-4e3b-b4f8-732f89866bcd None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:01.332598 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e18c5c-3b77-43f7-824d-eda07f99cbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:01.333309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e18c5c-3b77-43f7-824d-eda07f99cbd4 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:01.333655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e18c5c-3b77-43f7-824d-eda07f99cbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:01.333992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e18c5c-3b77-43f7-824d-eda07f99cbd4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:01.334631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e18c5c-3b77-43f7-824d-eda07f99cbd4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:01.336106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e18c5c-3b77-43f7-824d-eda07f99cbd4 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:01.350443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-10e18c5c-3b77-43f7-824d-eda07f99cbd4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:19:01.350443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:01.350443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:19:01.350443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:19:01.350443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:19:01.350443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:19:01.350443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:19:01.350443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:01.350443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:19:01.350443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:01.350443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:01.350443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:01.350443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:01.350443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:01.350443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:01.350443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:01.350443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:01.351738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:01.351738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:01.351738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:01.351738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:01.351738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:01.351738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:01.351738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:19:01.351738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:19:01.351738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:19:01.351738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:19:01.351738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:01.351738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:01.351738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:01.351738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:01.351738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:01.351738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:01.353297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:01.353297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:01.353297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:01.353297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:01.353297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:01.353297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:01.353297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:01.353297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:01.353297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:01.353297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:01.353297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:19:01.353297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:01.353297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:19:01.353297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:01.357280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 388/768] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:19:01 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:01.362966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e18c5c-3b77-43f7-824d-eda07f99cbd4 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:01.364808 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead027e-dc0b-459a-b092-d214f2f05d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:01.365596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead027e-dc0b-459a-b092-d214f2f05d63 None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:01.365971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead027e-dc0b-459a-b092-d214f2f05d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:01.366344 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead027e-dc0b-459a-b092-d214f2f05d63 None admin] PATH_INFO: `/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/4e5798be0fa544cf9cf48558e87fcfa9/roles/dd27845a836a4f6ebece149dbebc59c0` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:01.368504 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead027e-dc0b-459a-b092-d214f2f05d63 None admin] RBAC: Authorizing `identity:create_grant(project_id=f61085f09512451e92c9fa36fa9a8071, user_id=4e5798be0fa544cf9cf48558e87fcfa9, role_id=dd27845a836a4f6ebece149dbebc59c0)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:01.370049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead027e-dc0b-459a-b092-d214f2f05d63 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:01.394686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 381/769] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:19:01 2022] PUT /identity/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/4e5798be0fa544cf9cf48558e87fcfa9/roles/dd27845a836a4f6ebece149dbebc59c0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:19:01.591078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:01.608600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e18c5c-3b77-43f7-824d-eda07f99cbd4 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:01.646100 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dc4ef-fd1f-441e-93ac-5b5ecdb450e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:01.646738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dc4ef-fd1f-441e-93ac-5b5ecdb450e6 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:01.647044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dc4ef-fd1f-441e-93ac-5b5ecdb450e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:01.647314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dc4ef-fd1f-441e-93ac-5b5ecdb450e6 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:01.647948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695dc4ef-fd1f-441e-93ac-5b5ecdb450e6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:01.648246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695dc4ef-fd1f-441e-93ac-5b5ecdb450e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:01.650777 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695dc4ef-fd1f-441e-93ac-5b5ecdb450e6 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:01.656552 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 389/770] 10.222.0.25 () {56 vars in 1112 bytes} [Sat Sep 24 19:19:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:01.662278 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead027e-dc0b-459a-b092-d214f2f05d63 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:01.716485 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:01.774280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead027e-dc0b-459a-b092-d214f2f05d63 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:01.810539 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3e8a4-7862-4565-8f4d-8346d7378c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:01.811176 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3e8a4-7862-4565-8f4d-8346d7378c67 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:01.811456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3e8a4-7862-4565-8f4d-8346d7378c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:01.811725 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3e8a4-7862-4565-8f4d-8346d7378c67 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:01.812354 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3e8a4-7862-4565-8f4d-8346d7378c67 None admin] RBAC: Adding query filter params (type=network) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:01.812659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3e8a4-7862-4565-8f4d-8346d7378c67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:01.814014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3e8a4-7862-4565-8f4d-8346d7378c67 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:01.820504 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 382/771] 10.222.0.25 () {56 vars in 1112 bytes} [Sat Sep 24 19:19:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:01.826557 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dc4ef-fd1f-441e-93ac-5b5ecdb450e6 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:01.933881 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dc4ef-fd1f-441e-93ac-5b5ecdb450e6 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:01.969522 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329782b7-5972-4297-bf1f-979ddd92b4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:01.970051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329782b7-5972-4297-bf1f-979ddd92b4ee None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:01.970329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329782b7-5972-4297-bf1f-979ddd92b4ee None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:01.970596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329782b7-5972-4297-bf1f-979ddd92b4ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:01.971312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329782b7-5972-4297-bf1f-979ddd92b4ee None admin] RBAC: Adding query filter params (interface=public, service_id=5f36ec6e09294bafb9840240f9162c06, region_id=RegionOne) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:01.971617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329782b7-5972-4297-bf1f-979ddd92b4ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:01.972980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329782b7-5972-4297-bf1f-979ddd92b4ee None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:01.981997 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 390/772] 10.222.0.25 () {56 vars in 1251 bytes} [Sat Sep 24 19:19:01 2022] GET /identity/v3/endpoints?service_id=5f36ec6e09294bafb9840240f9162c06&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:01.987555 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3e8a4-7862-4565-8f4d-8346d7378c67 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:02.117498 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3e8a4-7862-4565-8f4d-8346d7378c67 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:02.133083 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:02.168907 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908ebc7-f827-41bd-a08f-28da37d43061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:02.169522 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908ebc7-f827-41bd-a08f-28da37d43061 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:02.169798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908ebc7-f827-41bd-a08f-28da37d43061 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:02.170068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908ebc7-f827-41bd-a08f-28da37d43061 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:02.170670 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908ebc7-f827-41bd-a08f-28da37d43061 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:02.172056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908ebc7-f827-41bd-a08f-28da37d43061 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:02.177625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 383/773] 10.222.0.25 () {56 vars in 1087 bytes} [Sat Sep 24 19:19:01 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:02.333014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6da2fd-1b0d-4b20-8a9b-16b1366e5ef3 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:02.333576 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6da2fd-1b0d-4b20-8a9b-16b1366e5ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:02.333657 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6da2fd-1b0d-4b20-8a9b-16b1366e5ef3 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:02.335420 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 391/774] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:02.341283 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fa9da-f94c-44b6-a5b6-836102d5a39f None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:02.341772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fa9da-f94c-44b6-a5b6-836102d5a39f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:02.341853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fa9da-f94c-44b6-a5b6-836102d5a39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:02.365923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-570fa9da-f94c-44b6-a5b6-836102d5a39f None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:02.367302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-570fa9da-f94c-44b6-a5b6-836102d5a39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:02.461257 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 384/775] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:02.834823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6da2fd-1b0d-4b20-8a9b-16b1366e5ef3 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:02.855270 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:02.972574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6da2fd-1b0d-4b20-8a9b-16b1366e5ef3 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:03.035337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435cad3-9978-4fff-a506-8c947b1a6bdd None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:03.035719 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435cad3-9978-4fff-a506-8c947b1a6bdd None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:03.035902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435cad3-9978-4fff-a506-8c947b1a6bdd None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:03.037466 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 385/776] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:19:03.042808 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c0799-dcd8-4add-9093-f681c2d23360 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:03.043121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c0799-dcd8-4add-9093-f681c2d23360 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:03.043399 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c0799-dcd8-4add-9093-f681c2d23360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:03.059387 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8855340-e7f4-4b28-af07-d7d8c1d334ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:03.060090 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8855340-e7f4-4b28-af07-d7d8c1d334ee None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:03.060466 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8855340-e7f4-4b28-af07-d7d8c1d334ee None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:03.060746 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8855340-e7f4-4b28-af07-d7d8c1d334ee None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:03.061332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8855340-e7f4-4b28-af07-d7d8c1d334ee None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:03.062956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8855340-e7f4-4b28-af07-d7d8c1d334ee None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:03.064491 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-cd6c0799-dcd8-4add-9093-f681c2d23360 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:03.066109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-cd6c0799-dcd8-4add-9093-f681c2d23360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:03.085061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-a8855340-e7f4-4b28-af07-d7d8c1d334ee None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:19:03.085061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:03.085061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:19:03.085061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:19:03.085061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:19:03.085061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:19:03.085061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:19:03.085061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:03.085061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:19:03.085061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:03.085061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:03.085061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:03.085061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:03.085061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:03.085061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:03.085061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:03.085061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:03.086085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:03.086085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:03.086085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:03.086085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:03.086085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:03.086085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:03.086085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:19:03.086085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:19:03.086085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:19:03.086085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:19:03.086085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:03.086085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:03.086085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:03.086085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:03.086085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:03.086085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:03.087565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:03.087565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:03.087565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:03.087565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:03.087565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:03.087565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:03.087565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:03.087565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:03.087565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:03.087565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:03.087565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:19:03.087565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:03.087565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:19:03.087565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:03.090256 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 392/777] 10.222.0.25 () {56 vars in 1129 bytes} [Sat Sep 24 19:19:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:03.097140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8855340-e7f4-4b28-af07-d7d8c1d334ee None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:03.145979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 386/778] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:03.243359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:03.259915 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8855340-e7f4-4b28-af07-d7d8c1d334ee None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:03.296988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07120984-ebd4-4286-85f9-433d534330cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:03.297751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07120984-ebd4-4286-85f9-433d534330cb None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:03.298035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07120984-ebd4-4286-85f9-433d534330cb None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:03.298292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07120984-ebd4-4286-85f9-433d534330cb None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:03.298949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07120984-ebd4-4286-85f9-433d534330cb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:03.299249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07120984-ebd4-4286-85f9-433d534330cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:03.300608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07120984-ebd4-4286-85f9-433d534330cb None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:03.305908 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 393/779] 10.222.0.25 () {56 vars in 1124 bytes} [Sat Sep 24 19:19:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:03.314735 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c0799-dcd8-4add-9093-f681c2d23360 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:03.368747 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:03.394026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5db41e-27ca-4a3f-8c8e-fe104cab0f01 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:03.394539 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5db41e-27ca-4a3f-8c8e-fe104cab0f01 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:03.394617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5db41e-27ca-4a3f-8c8e-fe104cab0f01 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:03.396113 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 394/780] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:03.402528 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9e72b-8db7-4617-bc48-8567fb6c12f4 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:03.403081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9e72b-8db7-4617-bc48-8567fb6c12f4 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:03.403581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9e72b-8db7-4617-bc48-8567fb6c12f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:03.439876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-2be9e72b-8db7-4617-bc48-8567fb6c12f4 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:03.439876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2be9e72b-8db7-4617-bc48-8567fb6c12f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:03.475940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c0799-dcd8-4add-9093-f681c2d23360 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:03.537076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 395/781] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:03.541221 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9e72b-8db7-4617-bc48-8567fb6c12f4 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:03.549030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9831834-7d67-44af-be86-3580993295f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:03.549638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9831834-7d67-44af-be86-3580993295f4 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:03.549915 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9831834-7d67-44af-be86-3580993295f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:03.550183 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9831834-7d67-44af-be86-3580993295f4 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:03.550811 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9831834-7d67-44af-be86-3580993295f4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:03.551137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9831834-7d67-44af-be86-3580993295f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:03.552642 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9831834-7d67-44af-be86-3580993295f4 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:03.558699 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 387/782] 10.222.0.25 () {56 vars in 1124 bytes} [Sat Sep 24 19:19:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:03.564269 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9831834-7d67-44af-be86-3580993295f4 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:03.621850 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:03.680049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9e72b-8db7-4617-bc48-8567fb6c12f4 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:03.707255 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9831834-7d67-44af-be86-3580993295f4 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:03.708941 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:03.750942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51607234-0666-40bd-b8b2-338eaed933b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:03.751581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51607234-0666-40bd-b8b2-338eaed933b9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:03.751921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51607234-0666-40bd-b8b2-338eaed933b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:03.752205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51607234-0666-40bd-b8b2-338eaed933b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:03.771539 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d731f0-0e85-4751-81a3-1e8c67615c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:03.772453 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d731f0-0e85-4751-81a3-1e8c67615c23 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:03.772736 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d731f0-0e85-4751-81a3-1e8c67615c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:03.773018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d731f0-0e85-4751-81a3-1e8c67615c23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:03.773982 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d731f0-0e85-4751-81a3-1e8c67615c23 None admin] RBAC: Adding query filter params (interface=public, service_id=754e78e73ac647b1b3c7540fdcbd67f8, region_id=RegionOne) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:03.774293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d731f0-0e85-4751-81a3-1e8c67615c23 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:03.776398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d731f0-0e85-4751-81a3-1e8c67615c23 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:03.778529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51607234-0666-40bd-b8b2-338eaed933b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:19:03.783531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-51607234-0666-40bd-b8b2-338eaed933b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:19:03.783531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:03.783531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:03.783531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:03.783531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:03.783531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:03.783531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:03.783531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:03.783531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:03.783531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:03.783531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:03.783531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:03.783531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:19:03.783531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:19:03.783531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:19:03.783531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:19:03.784457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:19:03.784457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:19:03.784457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:19:03.784457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:19:03.784457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:03.784457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:03.784457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:03.784457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:03.784457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:03.784457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:03.784457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:03.784457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:03.784457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:03.784457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:03.784457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:03.784457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:03.785309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:03.785309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:03.785309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:03.785309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:03.785309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:19:03.785309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:19:03.785309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:19:03.785309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:19:03.785309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:19:03.785309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:19:03.785309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:19:03.785309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:03.789520 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 396/783] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:19:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:03.794408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51607234-0666-40bd-b8b2-338eaed933b9 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:03.805536 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 388/784] 10.222.0.25 () {56 vars in 1251 bytes} [Sat Sep 24 19:19:03 2022] GET /identity/v3/endpoints?service_id=754e78e73ac647b1b3c7540fdcbd67f8&interface=public®ion_id=RegionOne => generated 194 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:03.807171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d731f0-0e85-4751-81a3-1e8c67615c23 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:03.936876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d731f0-0e85-4751-81a3-1e8c67615c23 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:03.940057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51607234-0666-40bd-b8b2-338eaed933b9 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:03.975882 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba565ea-4363-47cc-ad5c-1231dd4e9b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:03.976550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba565ea-4363-47cc-ad5c-1231dd4e9b92 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:03.976945 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:03.977337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba565ea-4363-47cc-ad5c-1231dd4e9b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:03.979365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba565ea-4363-47cc-ad5c-1231dd4e9b92 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:03.980157 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba565ea-4363-47cc-ad5c-1231dd4e9b92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:03.981739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba565ea-4363-47cc-ad5c-1231dd4e9b92 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:03.983665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abdbb3-9b60-42bd-86d4-c2413e508ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:03.984689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abdbb3-9b60-42bd-86d4-c2413e508ceb None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:03.985313 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abdbb3-9b60-42bd-86d4-c2413e508ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:03.985897 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abdbb3-9b60-42bd-86d4-c2413e508ceb None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:03.987200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abdbb3-9b60-42bd-86d4-c2413e508ceb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:03.987578 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abdbb3-9b60-42bd-86d4-c2413e508ceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:03.989062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abdbb3-9b60-42bd-86d4-c2413e508ceb None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:03.995053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 389/785] 10.222.0.25 () {56 vars in 1087 bytes} [Sat Sep 24 19:19:03 2022] GET /identity/v3/services => generated 772 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:03.996252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba565ea-4363-47cc-ad5c-1231dd4e9b92 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:04.003425 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 397/786] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:19:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:04.004785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abdbb3-9b60-42bd-86d4-c2413e508ceb None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:04.067227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:04.119232 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abdbb3-9b60-42bd-86d4-c2413e508ceb None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:04.157825 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecce2e1-4f57-4f1e-9599-111d92361637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:04.158569 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecce2e1-4f57-4f1e-9599-111d92361637 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:04.158961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecce2e1-4f57-4f1e-9599-111d92361637 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:04.159306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecce2e1-4f57-4f1e-9599-111d92361637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:04.189846 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecce2e1-4f57-4f1e-9599-111d92361637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:04.191244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecce2e1-4f57-4f1e-9599-111d92361637 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:04.223856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-9ecce2e1-4f57-4f1e-9599-111d92361637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:04.223856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:04.223856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:04.223856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:04.223856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:04.223856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:04.223856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:04.223856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:04.223856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:04.223856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:04.223856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:04.223856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:04.223856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:04.223856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:04.223856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:04.223856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:04.225071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:04.225071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:04.225071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:04.225071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:04.225071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:04.225071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:04.225071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:04.225071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:04.225071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:04.225071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:04.225071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:04.225071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:04.225071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:04.225071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:04.225071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:04.225071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:04.225071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:04.226169 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:04.226169 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:04.226169 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:04.226464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 398/787] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:04.230556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba565ea-4363-47cc-ad5c-1231dd4e9b92 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:04.233641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecce2e1-4f57-4f1e-9599-111d92361637 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:04.293613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5b935-d17b-4086-abbd-520f6d0b6fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:04.294350 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5b935-d17b-4086-abbd-520f6d0b6fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:04.294630 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5b935-d17b-4086-abbd-520f6d0b6fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:04.295352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5b935-d17b-4086-abbd-520f6d0b6fb5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:04.308264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5b935-d17b-4086-abbd-520f6d0b6fb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:19:04.310573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:04.315594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-7ec5b935-d17b-4086-abbd-520f6d0b6fb5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:19:04.315594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:04.315594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:04.315594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:04.315594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:04.315594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:04.315594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:04.315594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:04.315594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:04.315594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:04.315594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:04.315594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:04.315594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:19:04.315594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:19:04.315594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:19:04.315594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:19:04.317151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:19:04.317151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:19:04.317151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:19:04.317151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:19:04.317151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:04.317151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:04.317151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:04.317151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:04.317151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:04.317151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:04.317151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:04.317151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:04.317151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:04.317151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:04.317151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:04.317151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:04.318015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:04.318015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:04.318015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:04.318015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:04.318015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:19:04.318015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:19:04.318015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:19:04.318015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:19:04.318015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:19:04.318015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:19:04.318015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:19:04.318015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:04.318015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 390/788] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:19:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:04.323704 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5b935-d17b-4086-abbd-520f6d0b6fb5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:04.373128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecce2e1-4f57-4f1e-9599-111d92361637 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:04.411463 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf5f4d-1c77-48de-aa02-146d16e57f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:04.412111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf5f4d-1c77-48de-aa02-146d16e57f64 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:04.412338 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf5f4d-1c77-48de-aa02-146d16e57f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:04.414020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf5f4d-1c77-48de-aa02-146d16e57f64 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:04.414020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf5f4d-1c77-48de-aa02-146d16e57f64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:04.414020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf5f4d-1c77-48de-aa02-146d16e57f64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:04.414909 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf5f4d-1c77-48de-aa02-146d16e57f64 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:04.429086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:04.434016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 399/789] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:04.435416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe07644-e4be-42f7-aa70-9b7ff6a59b42 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:04.435706 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe07644-e4be-42f7-aa70-9b7ff6a59b42 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:04.435984 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe07644-e4be-42f7-aa70-9b7ff6a59b42 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:04.437555 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 400/790] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:04.438962 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe07644-e4be-42f7-aa70-9b7ff6a59b42 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:04.449764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5b935-d17b-4086-abbd-520f6d0b6fb5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:04.488165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fb8c7-aa7d-41ae-85c8-3e6047b3241a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:04.489326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fb8c7-aa7d-41ae-85c8-3e6047b3241a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:04.489860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fb8c7-aa7d-41ae-85c8-3e6047b3241a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:04.490326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fb8c7-aa7d-41ae-85c8-3e6047b3241a None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:04.491274 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fb8c7-aa7d-41ae-85c8-3e6047b3241a None admin] RBAC: Adding query filter params (name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:04.491888 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fb8c7-aa7d-41ae-85c8-3e6047b3241a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:04.494472 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fb8c7-aa7d-41ae-85c8-3e6047b3241a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:04.504433 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 391/791] 10.222.0.25 () {56 vars in 1103 bytes} [Sat Sep 24 19:19:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:04.506271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328efe9-9253-42f4-8bac-054b50b8e580 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:04.506768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328efe9-9253-42f4-8bac-054b50b8e580 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:04.507266 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328efe9-9253-42f4-8bac-054b50b8e580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:04.528240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-e328efe9-9253-42f4-8bac-054b50b8e580 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:04.529871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-e328efe9-9253-42f4-8bac-054b50b8e580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:04.552051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe07644-e4be-42f7-aa70-9b7ff6a59b42 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:04.554442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:04.594949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a7632-1b06-4f0b-b831-2df58dbc6925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:04.595581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a7632-1b06-4f0b-b831-2df58dbc6925 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:04.595860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a7632-1b06-4f0b-b831-2df58dbc6925 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:04.596130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a7632-1b06-4f0b-b831-2df58dbc6925 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:04.605292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a7632-1b06-4f0b-b831-2df58dbc6925 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:04.606731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a7632-1b06-4f0b-b831-2df58dbc6925 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:04.619244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-702a7632-1b06-4f0b-b831-2df58dbc6925 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:19:04.619244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:04.619244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:04.619244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:04.619244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:04.619244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:04.619244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:04.619244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:04.619244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:04.619244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:04.619244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:04.619244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:04.619244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:19:04.619244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:19:04.619244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:19:04.619244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:19:04.620208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:04.620208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:04.620208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:19:04.620208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:04.620208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:19:04.620208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:04.620208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:04.620208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:04.620208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:04.620208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:04.620208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:04.620208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:04.620208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:04.620208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:04.620208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:04.620208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:04.620208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:04.620208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:04.621160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:04.621160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:04.621160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:19:04.621160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:19:04.621160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:19:04.621160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:19:04.621160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:19:04.621160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:19:04.621160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:19:04.621160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:04.622378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 392/793] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:04.623523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328efe9-9253-42f4-8bac-054b50b8e580 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:04.625067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 401/793] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:19:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:04.626324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a7632-1b06-4f0b-b831-2df58dbc6925 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:04.742455 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a7632-1b06-4f0b-b831-2df58dbc6925 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:04.783619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:04.811008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3b1c9-6d23-4dfc-9d26-53252dd20b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:04.811909 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3b1c9-6d23-4dfc-9d26-53252dd20b33 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:04.812397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3b1c9-6d23-4dfc-9d26-53252dd20b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:04.813933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3b1c9-6d23-4dfc-9d26-53252dd20b33 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:04.814861 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3b1c9-6d23-4dfc-9d26-53252dd20b33 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:04.816060 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3b1c9-6d23-4dfc-9d26-53252dd20b33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:04.817680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3b1c9-6d23-4dfc-9d26-53252dd20b33 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:04.822608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328efe9-9253-42f4-8bac-054b50b8e580 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:04.865175 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 402/794] 10.222.0.25 () {56 vars in 1135 bytes} [Sat Sep 24 19:19:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:04.871337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3b1c9-6d23-4dfc-9d26-53252dd20b33 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:04.875554 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eeab90-d5cb-4483-8891-c2a374258627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:04.876219 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eeab90-d5cb-4483-8891-c2a374258627 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:04.876501 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eeab90-d5cb-4483-8891-c2a374258627 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:04.876769 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eeab90-d5cb-4483-8891-c2a374258627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:04.908348 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eeab90-d5cb-4483-8891-c2a374258627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:04.909807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eeab90-d5cb-4483-8891-c2a374258627 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:04.911174 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:04.935966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-33eeab90-d5cb-4483-8891-c2a374258627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:04.935966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:04.935966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:04.935966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:04.935966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:04.935966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:04.935966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:04.935966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:04.935966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:04.935966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:04.935966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:04.935966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:04.935966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:04.935966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:04.935966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:04.935966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:04.937025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:04.937025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:04.937025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:04.937025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:04.937025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:04.937025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:04.937025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:04.937025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:04.937025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:04.937025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:04.937025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:04.937025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:04.937025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:04.937025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:04.937025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:04.937025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:04.937025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:04.937940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:04.937940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:04.937940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:04.939185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 393/795] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:04.942563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eeab90-d5cb-4483-8891-c2a374258627 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:05.016659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3b1c9-6d23-4dfc-9d26-53252dd20b33 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:05.054178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eeab90-d5cb-4483-8891-c2a374258627 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:05.059678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd92f5-c917-460c-a33a-87ca83f76069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:05.060585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd92f5-c917-460c-a33a-87ca83f76069 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:05.061104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd92f5-c917-460c-a33a-87ca83f76069 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:05.061780 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd92f5-c917-460c-a33a-87ca83f76069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:05.074564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd92f5-c917-460c-a33a-87ca83f76069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:05.076333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd92f5-c917-460c-a33a-87ca83f76069 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:05.084885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:05.091313 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6b024-c511-4d4b-a736-dbe39e056199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:05.091926 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6b024-c511-4d4b-a736-dbe39e056199 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:05.092206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6b024-c511-4d4b-a736-dbe39e056199 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:05.092480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6b024-c511-4d4b-a736-dbe39e056199 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:05.093126 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6b024-c511-4d4b-a736-dbe39e056199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:05.093430 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6b024-c511-4d4b-a736-dbe39e056199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:05.094802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6b024-c511-4d4b-a736-dbe39e056199 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:05.097696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-0ffd92f5-c917-460c-a33a-87ca83f76069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:05.097696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:05.097696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:05.097696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:05.097696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:05.097696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:05.097696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:05.097696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:05.097696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:05.097696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:05.097696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:05.097696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:05.097696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:05.097696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:05.097696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:05.097696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:05.098628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:05.098628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:05.098628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:05.098628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:05.098628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:05.098628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:05.098628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:05.098628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:05.098628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:05.098628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:05.098628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:05.098628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:05.098628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:05.098628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:05.098628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:05.098628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:05.098628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:05.099621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:05.099621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:05.099621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:05.105825 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 403/796] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:05.105825 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd92f5-c917-460c-a33a-87ca83f76069 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:05.108468 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 394/797] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:05.109640 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d84d2e-3776-45b1-b4d5-71b8b31ad165 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:05.109836 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d84d2e-3776-45b1-b4d5-71b8b31ad165 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:05.112463 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d84d2e-3776-45b1-b4d5-71b8b31ad165 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:05.115432 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 395/798] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:05.116057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d84d2e-3776-45b1-b4d5-71b8b31ad165 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:05.189891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:05.218066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd92f5-c917-460c-a33a-87ca83f76069 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:05.225185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d84d2e-3776-45b1-b4d5-71b8b31ad165 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:05.252649 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2da330-c1d6-4251-b424-b9bac902bd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:05.253268 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2da330-c1d6-4251-b424-b9bac902bd19 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:05.253539 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2da330-c1d6-4251-b424-b9bac902bd19 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:05.253805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2da330-c1d6-4251-b424-b9bac902bd19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:05.260392 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9b95f-4850-4464-843a-f2e1a5026c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:05.261000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9b95f-4850-4464-843a-f2e1a5026c5d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:05.261283 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9b95f-4850-4464-843a-f2e1a5026c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:05.261564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9b95f-4850-4464-843a-f2e1a5026c5d None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:05.262206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9b95f-4850-4464-843a-f2e1a5026c5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:05.262511 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9b95f-4850-4464-843a-f2e1a5026c5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:05.263931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9b95f-4850-4464-843a-f2e1a5026c5d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:05.264775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2da330-c1d6-4251-b424-b9bac902bd19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:19:05.270062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-ef2da330-c1d6-4251-b424-b9bac902bd19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:19:05.270062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:05.270062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:05.270062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:05.270062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:05.270062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:05.270062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:05.270062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:05.270062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:05.270062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:05.270062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:05.270062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:05.270062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:19:05.270062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:19:05.270062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:19:05.270062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:19:05.271058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:19:05.271058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:19:05.271058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:19:05.271058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:19:05.271058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:05.271058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:05.271058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:05.271058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:05.271058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:05.271058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:05.271058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:05.271058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:05.271058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:05.271058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:05.271058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:05.271058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:05.272187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:05.272187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:05.272187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:05.272187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:05.272187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:19:05.272187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:19:05.272187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:19:05.272187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:19:05.272187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:19:05.272187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:19:05.272187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:19:05.272187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:05.274237 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 404/799] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:19:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:05.275859 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2da330-c1d6-4251-b424-b9bac902bd19 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:05.281681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 396/800] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:05.282996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd5100-1ba0-4fdd-8061-0f9ca729b684 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:05.283288 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd5100-1ba0-4fdd-8061-0f9ca729b684 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:05.283648 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd5100-1ba0-4fdd-8061-0f9ca729b684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:05.302271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-20fd5100-1ba0-4fdd-8061-0f9ca729b684 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:05.303545 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-20fd5100-1ba0-4fdd-8061-0f9ca729b684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:05.356913 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:05.379073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 397/801] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:05.380099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd5100-1ba0-4fdd-8061-0f9ca729b684 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:05.395549 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2da330-c1d6-4251-b424-b9bac902bd19 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:05.447144 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e24fc-a7bd-4131-a5c2-81d4cd8fc441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:05.448022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e24fc-a7bd-4131-a5c2-81d4cd8fc441 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:05.448427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e24fc-a7bd-4131-a5c2-81d4cd8fc441 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:05.448789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e24fc-a7bd-4131-a5c2-81d4cd8fc441 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:05.450886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:05.460716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e24fc-a7bd-4131-a5c2-81d4cd8fc441 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:05.462908 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e24fc-a7bd-4131-a5c2-81d4cd8fc441 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:05.478980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-cc6e24fc-a7bd-4131-a5c2-81d4cd8fc441 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:19:05.478980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:05.478980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:05.478980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:05.478980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:05.478980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:05.478980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:05.478980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:05.478980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:05.478980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:05.478980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:05.478980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:05.478980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:19:05.478980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:19:05.478980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:19:05.478980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:19:05.480013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:05.480013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:05.480013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:19:05.480013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:05.480013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:19:05.480013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:05.480013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:05.480013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:05.480013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:05.480013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:05.480013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:05.480013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:05.480013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:05.480013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:05.480013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:05.480013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:05.480013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:05.480013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:05.480957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:05.480957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:05.480957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:19:05.480957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:19:05.480957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:19:05.480957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:19:05.480957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:19:05.480957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:19:05.480957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:19:05.480957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:05.480957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 405/802] 10.222.0.25 () {56 vars in 1117 bytes} [Sat Sep 24 19:19:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:05.481749 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e24fc-a7bd-4131-a5c2-81d4cd8fc441 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:05.529030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd5100-1ba0-4fdd-8061-0f9ca729b684 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:05.566795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c18615-e685-4a32-9cac-83a9fabbb896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:05.567762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c18615-e685-4a32-9cac-83a9fabbb896 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:05.568215 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c18615-e685-4a32-9cac-83a9fabbb896 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:05.568739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c18615-e685-4a32-9cac-83a9fabbb896 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:05.569568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c18615-e685-4a32-9cac-83a9fabbb896 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:05.570041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c18615-e685-4a32-9cac-83a9fabbb896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:05.572196 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c18615-e685-4a32-9cac-83a9fabbb896 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:05.587411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 398/803] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:19:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:05.588275 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c18615-e685-4a32-9cac-83a9fabbb896 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:05.606850 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e24fc-a7bd-4131-a5c2-81d4cd8fc441 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:05.644607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a9352-7101-4429-ab5f-c67f5b0c99aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:05.645659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a9352-7101-4429-ab5f-c67f5b0c99aa None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:05.646156 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a9352-7101-4429-ab5f-c67f5b0c99aa None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:05.646642 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a9352-7101-4429-ab5f-c67f5b0c99aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:05.647624 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:05.656842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a9352-7101-4429-ab5f-c67f5b0c99aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:05.658545 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a9352-7101-4429-ab5f-c67f5b0c99aa None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:05.671974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-524a9352-7101-4429-ab5f-c67f5b0c99aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:05.671974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:05.671974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:05.671974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:05.671974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:05.671974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:05.671974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:05.671974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:05.671974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:05.671974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:05.671974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:05.671974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:05.671974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:19:05.671974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:19:05.671974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:19:05.672921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:19:05.672921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:05.672921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:05.672921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:05.672921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:05.672921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:05.672921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:05.672921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:05.672921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:05.672921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:05.672921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:05.672921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:05.672921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:05.672921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:05.672921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:05.672921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:05.672921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:05.673839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:19:05.673839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:19:05.673839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:19:05.673839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:19:05.673839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:19:05.673839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:19:05.673839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:05.673839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:05.674713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 406/804] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:19:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:05.675401 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a9352-7101-4429-ab5f-c67f5b0c99aa None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:05.709772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c18615-e685-4a32-9cac-83a9fabbb896 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:05.733470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:05.746622 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ad20a-1f1d-42d6-927a-48b14ad11ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:05.747341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ad20a-1f1d-42d6-927a-48b14ad11ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:05.747543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ad20a-1f1d-42d6-927a-48b14ad11ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:05.747815 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ad20a-1f1d-42d6-927a-48b14ad11ce2 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:05.748579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ad20a-1f1d-42d6-927a-48b14ad11ce2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:05.748872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ad20a-1f1d-42d6-927a-48b14ad11ce2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:05.750294 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ad20a-1f1d-42d6-927a-48b14ad11ce2 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:05.772074 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 399/805] 10.222.0.25 () {56 vars in 1149 bytes} [Sat Sep 24 19:19:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:05.772074 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ad20a-1f1d-42d6-927a-48b14ad11ce2 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:05.786589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a9352-7101-4429-ab5f-c67f5b0c99aa None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:05.823017 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1afa7f9-2225-48e9-a0e4-7524a1cc248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:05.823749 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afa7f9-2225-48e9-a0e4-7524a1cc248c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:05.824028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afa7f9-2225-48e9-a0e4-7524a1cc248c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:05.824301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afa7f9-2225-48e9-a0e4-7524a1cc248c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:05.835655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1afa7f9-2225-48e9-a0e4-7524a1cc248c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:05.837105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1afa7f9-2225-48e9-a0e4-7524a1cc248c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:05.851378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-c1afa7f9-2225-48e9-a0e4-7524a1cc248c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:05.851378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:05.851378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:05.851378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:05.851378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:05.851378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:05.851378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:05.851378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:05.851378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:05.851378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:05.851378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:05.851378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:05.851378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:05.851378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:05.851378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:05.851378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:05.852365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:05.852365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:05.852365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:05.852365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:05.852365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:05.852365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:05.852365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:05.852365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:05.852365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:05.852365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:05.852365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:05.852365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:05.852365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:05.852365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:05.852365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:05.852365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:05.852365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:05.853425 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:05.853425 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:05.853425 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:05.853425 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 407/806] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:05.854237 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1afa7f9-2225-48e9-a0e4-7524a1cc248c None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:05.878961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ad20a-1f1d-42d6-927a-48b14ad11ce2 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:05.881247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:05.919179 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33244c4a-91b1-40e6-8520-2e07f0322ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:05.920521 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33244c4a-91b1-40e6-8520-2e07f0322ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:05.921096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33244c4a-91b1-40e6-8520-2e07f0322ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:05.921632 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33244c4a-91b1-40e6-8520-2e07f0322ed1 None admin] PATH_INFO: `/v3/services/network` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:05.922364 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33244c4a-91b1-40e6-8520-2e07f0322ed1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:05.924092 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33244c4a-91b1-40e6-8520-2e07f0322ed1 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:05.936434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-33244c4a-91b1-40e6-8520-2e07f0322ed1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:19:05.936434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:05.936434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:19:05.936434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:19:05.936434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:19:05.936434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:19:05.936434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:19:05.936434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:05.936434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:19:05.936434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:05.936434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:05.936434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:05.936434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:05.936434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:05.936434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:05.936434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:05.936434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:05.937674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:05.937674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:05.937674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:05.937674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:05.937674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:05.937674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:05.937674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:19:05.937674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:19:05.937674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:19:05.937674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:19:05.937674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:05.937674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:05.937674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:05.937674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:05.937674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:05.937674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:05.938739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:05.938739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:05.938739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:05.938739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:05.938739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:05.938739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:05.938739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:05.938739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:05.938739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:05.938739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:05.938739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:19:05.938739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:05.938739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:19:05.938739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:05.940242 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 400/807] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:19:05 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:05.940804 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33244c4a-91b1-40e6-8520-2e07f0322ed1 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:05.970181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1afa7f9-2225-48e9-a0e4-7524a1cc248c None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:05.979300 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:06.008364 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab67163-ed54-4b2f-ab42-8706e26d5076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:06.009050 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab67163-ed54-4b2f-ab42-8706e26d5076 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:06.009293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab67163-ed54-4b2f-ab42-8706e26d5076 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:06.009642 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab67163-ed54-4b2f-ab42-8706e26d5076 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:06.010346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab67163-ed54-4b2f-ab42-8706e26d5076 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:06.010649 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab67163-ed54-4b2f-ab42-8706e26d5076 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:06.012088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab67163-ed54-4b2f-ab42-8706e26d5076 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:06.029404 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 408/808] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:19:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:06.029404 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab67163-ed54-4b2f-ab42-8706e26d5076 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:06.053791 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33244c4a-91b1-40e6-8520-2e07f0322ed1 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:06.091383 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55a986-0e55-49de-b3a2-aef624097429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:06.092320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55a986-0e55-49de-b3a2-aef624097429 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:06.092680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55a986-0e55-49de-b3a2-aef624097429 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:06.092957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55a986-0e55-49de-b3a2-aef624097429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:06.106536 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55a986-0e55-49de-b3a2-aef624097429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:06.108055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55a986-0e55-49de-b3a2-aef624097429 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:06.123992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-0f55a986-0e55-49de-b3a2-aef624097429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:06.123992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:06.123992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:06.123992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:06.123992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:06.123992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:06.123992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:06.123992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:06.123992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:06.123992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:06.123992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:06.123992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:06.123992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:06.123992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:06.123992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:06.123992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:06.125020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:06.125020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:06.125020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:06.125020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:06.125020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:06.125020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:06.125020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:06.125020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:06.125020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:06.125020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:06.125020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:06.125020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:06.125020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:06.125020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:06.125020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:06.125020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:06.125020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:06.125929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:06.125929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:06.125929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:06.127211 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 401/809] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:06.128468 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55a986-0e55-49de-b3a2-aef624097429 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:06.137852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab67163-ed54-4b2f-ab42-8706e26d5076 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:06.150332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:06.175430 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df2686-76d8-4492-8216-4bcaf3f9db75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:06.176213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df2686-76d8-4492-8216-4bcaf3f9db75 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:06.176327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df2686-76d8-4492-8216-4bcaf3f9db75 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:06.176588 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df2686-76d8-4492-8216-4bcaf3f9db75 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:06.177222 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df2686-76d8-4492-8216-4bcaf3f9db75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:06.177518 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df2686-76d8-4492-8216-4bcaf3f9db75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:06.178886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df2686-76d8-4492-8216-4bcaf3f9db75 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:06.196719 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 409/810] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:06.196719 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df2686-76d8-4492-8216-4bcaf3f9db75 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:06.227068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:06.236374 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55a986-0e55-49de-b3a2-aef624097429 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:06.271509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f266c-aaa6-4ff9-9de5-0f86dcd06ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:06.272120 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f266c-aaa6-4ff9-9de5-0f86dcd06ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:06.272398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f266c-aaa6-4ff9-9de5-0f86dcd06ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:06.272667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f266c-aaa6-4ff9-9de5-0f86dcd06ca1 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:06.273282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f266c-aaa6-4ff9-9de5-0f86dcd06ca1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:06.273580 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f266c-aaa6-4ff9-9de5-0f86dcd06ca1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:06.275683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f266c-aaa6-4ff9-9de5-0f86dcd06ca1 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:06.280294 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 402/811] 10.222.0.25 () {56 vars in 1112 bytes} [Sat Sep 24 19:19:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:06.284969 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f266c-aaa6-4ff9-9de5-0f86dcd06ca1 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:06.313545 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df2686-76d8-4492-8216-4bcaf3f9db75 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:06.351302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5929636-956e-4a36-b881-3056d4e2fcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:06.351955 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5929636-956e-4a36-b881-3056d4e2fcd8 None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:06.352234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5929636-956e-4a36-b881-3056d4e2fcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:06.353139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5929636-956e-4a36-b881-3056d4e2fcd8 None admin] PATH_INFO: `/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/85b45de73f7b4f7da7e0e8d8375deb37/roles/dd27845a836a4f6ebece149dbebc59c0` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:06.355262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5929636-956e-4a36-b881-3056d4e2fcd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f61085f09512451e92c9fa36fa9a8071, user_id=85b45de73f7b4f7da7e0e8d8375deb37, role_id=dd27845a836a4f6ebece149dbebc59c0)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:06.356690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5929636-956e-4a36-b881-3056d4e2fcd8 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:06.368530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:06.378967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 410/812] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:19:06 2022] PUT /identity/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/85b45de73f7b4f7da7e0e8d8375deb37/roles/dd27845a836a4f6ebece149dbebc59c0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:19:06.380106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5929636-956e-4a36-b881-3056d4e2fcd8 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:06.405411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f266c-aaa6-4ff9-9de5-0f86dcd06ca1 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:06.458679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523f686-d780-4116-a518-0c1d3b1bebe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:06.459395 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523f686-d780-4116-a518-0c1d3b1bebe8 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:06.459678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523f686-d780-4116-a518-0c1d3b1bebe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:06.459948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523f686-d780-4116-a518-0c1d3b1bebe8 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:06.461431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523f686-d780-4116-a518-0c1d3b1bebe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:06.461788 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523f686-d780-4116-a518-0c1d3b1bebe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:06.464276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523f686-d780-4116-a518-0c1d3b1bebe8 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:06.481745 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 403/813] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:06.482993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523f686-d780-4116-a518-0c1d3b1bebe8 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:06.505720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:06.526331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5929636-956e-4a36-b881-3056d4e2fcd8 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:06.570321 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e0d82-f6f7-43c5-87e8-9dd75de3e1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:06.572318 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e0d82-f6f7-43c5-87e8-9dd75de3e1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:06.572318 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e0d82-f6f7-43c5-87e8-9dd75de3e1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:06.572318 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e0d82-f6f7-43c5-87e8-9dd75de3e1c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:06.582894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e0d82-f6f7-43c5-87e8-9dd75de3e1c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:06.584816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e0d82-f6f7-43c5-87e8-9dd75de3e1c8 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:06.599341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-9d0e0d82-f6f7-43c5-87e8-9dd75de3e1c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:19:06.599341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:06.599341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:06.599341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:06.599341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:06.599341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:06.599341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:06.599341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:06.599341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:06.599341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:06.599341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:06.599341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:06.599341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:19:06.599341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:19:06.599341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:19:06.599341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:19:06.600355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:06.600355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:06.600355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:19:06.600355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:06.600355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:19:06.600355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:06.600355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:06.600355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:06.600355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:06.600355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:06.600355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:06.600355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:06.600355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:06.600355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:06.600355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:06.600355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:06.600355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:06.600355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:06.601311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:06.601311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:06.601311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:19:06.601311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:19:06.601311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:19:06.601311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:19:06.601311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:19:06.601311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:19:06.601311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:19:06.601311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:06.608311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 411/814] 10.222.0.25 () {56 vars in 1093 bytes} [Sat Sep 24 19:19:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:06.608311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e0d82-f6f7-43c5-87e8-9dd75de3e1c8 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:06.611328 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523f686-d780-4116-a518-0c1d3b1bebe8 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:06.647593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d639f-728e-492d-83a0-04d46aeda1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:06.648202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d639f-728e-492d-83a0-04d46aeda1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:06.648481 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d639f-728e-492d-83a0-04d46aeda1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:06.649004 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d639f-728e-492d-83a0-04d46aeda1a8 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:06.650297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d639f-728e-492d-83a0-04d46aeda1a8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:06.650690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d639f-728e-492d-83a0-04d46aeda1a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:06.652114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d639f-728e-492d-83a0-04d46aeda1a8 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:06.661336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 404/815] 10.222.0.25 () {56 vars in 1112 bytes} [Sat Sep 24 19:19:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:06.661336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3220e2-7d66-445f-90b8-78416f6fd74d None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:06.661336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3220e2-7d66-445f-90b8-78416f6fd74d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:06.661336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3220e2-7d66-445f-90b8-78416f6fd74d None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:06.661336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 405/816] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:06.661336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3220e2-7d66-445f-90b8-78416f6fd74d None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:06.670866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:06.723656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e0d82-f6f7-43c5-87e8-9dd75de3e1c8 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:06.761034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02978201-5280-4cef-a0a5-19d58c4f8144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:06.761961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02978201-5280-4cef-a0a5-19d58c4f8144 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:06.762236 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02978201-5280-4cef-a0a5-19d58c4f8144 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:06.762508 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02978201-5280-4cef-a0a5-19d58c4f8144 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:06.770380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02978201-5280-4cef-a0a5-19d58c4f8144 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:06.771880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02978201-5280-4cef-a0a5-19d58c4f8144 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:06.772731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3220e2-7d66-445f-90b8-78416f6fd74d None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:06.784246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-02978201-5280-4cef-a0a5-19d58c4f8144 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:06.784246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:06.784246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:06.784246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:06.784246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:06.784246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:06.784246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:06.784246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:06.784246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:06.784246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:06.784246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:06.784246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:06.784246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:19:06.784246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:19:06.784246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:19:06.785171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:19:06.785171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:06.785171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:06.785171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:06.785171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:06.785171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:06.785171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:06.785171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:06.785171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:06.785171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:06.785171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:06.785171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:06.785171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:06.785171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:06.785171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:06.785171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:06.785171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:06.786077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:19:06.786077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:19:06.786077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:19:06.786077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:19:06.786077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:19:06.786077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:19:06.786077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:06.786077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:06.786077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 412/817] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:19:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:06.786077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02978201-5280-4cef-a0a5-19d58c4f8144 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:06.796442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:06.816084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99af87d-576b-491e-ba5c-14a9c7cf5f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:06.816700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99af87d-576b-491e-ba5c-14a9c7cf5f9d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:06.816978 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99af87d-576b-491e-ba5c-14a9c7cf5f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:06.817268 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99af87d-576b-491e-ba5c-14a9c7cf5f9d None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:06.817977 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99af87d-576b-491e-ba5c-14a9c7cf5f9d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:06.818289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99af87d-576b-491e-ba5c-14a9c7cf5f9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:06.819756 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99af87d-576b-491e-ba5c-14a9c7cf5f9d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:06.843157 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 406/818] 10.222.0.25 () {56 vars in 1133 bytes} [Sat Sep 24 19:19:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:06.843157 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73659aa-ba9d-45bf-a0d5-7ff2e70c46cd None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:06.843157 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73659aa-ba9d-45bf-a0d5-7ff2e70c46cd None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:06.843157 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73659aa-ba9d-45bf-a0d5-7ff2e70c46cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:06.859733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-b73659aa-ba9d-45bf-a0d5-7ff2e70c46cd None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:06.861035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b73659aa-ba9d-45bf-a0d5-7ff2e70c46cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:06.898530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02978201-5280-4cef-a0a5-19d58c4f8144 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:06.924192 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:06.942858 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 407/819] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:06.942858 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73659aa-ba9d-45bf-a0d5-7ff2e70c46cd None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:06.943135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f59ff1-3f8c-4621-bda8-184a7752f2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:06.943135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f59ff1-3f8c-4621-bda8-184a7752f2e0 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:06.943135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f59ff1-3f8c-4621-bda8-184a7752f2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:06.943135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f59ff1-3f8c-4621-bda8-184a7752f2e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:06.943409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f59ff1-3f8c-4621-bda8-184a7752f2e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:06.943409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f59ff1-3f8c-4621-bda8-184a7752f2e0 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:06.966901 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 413/820] 10.222.0.25 () {60 vars in 1144 bytes} [Sat Sep 24 19:19:06 2022] POST /identity/v3/endpoints => generated 337 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:19:06.967844 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f59ff1-3f8c-4621-bda8-184a7752f2e0 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:07.045300 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:07.111182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f59ff1-3f8c-4621-bda8-184a7752f2e0 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:07.151225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09eff6-fb59-4474-95f5-b2522c33fcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:07.151873 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09eff6-fb59-4474-95f5-b2522c33fcc2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:07.152152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09eff6-fb59-4474-95f5-b2522c33fcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:07.152423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09eff6-fb59-4474-95f5-b2522c33fcc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:07.200992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73659aa-ba9d-45bf-a0d5-7ff2e70c46cd None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:07.229930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09eff6-fb59-4474-95f5-b2522c33fcc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:07.231411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09eff6-fb59-4474-95f5-b2522c33fcc2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:07.275585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add99c0c-3dfa-4dc6-8181-1c43928029bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:07.276413 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add99c0c-3dfa-4dc6-8181-1c43928029bb None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:07.276760 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add99c0c-3dfa-4dc6-8181-1c43928029bb None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:07.277942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add99c0c-3dfa-4dc6-8181-1c43928029bb None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:07.278742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add99c0c-3dfa-4dc6-8181-1c43928029bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:07.279148 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add99c0c-3dfa-4dc6-8181-1c43928029bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:07.280707 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add99c0c-3dfa-4dc6-8181-1c43928029bb None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:07.298909 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 408/821] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:19:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:07.299937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add99c0c-3dfa-4dc6-8181-1c43928029bb None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:07.307363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:07.360978 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 414/822] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:19:06 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:19:07.361872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09eff6-fb59-4474-95f5-b2522c33fcc2 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:07.366935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:07.425095 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add99c0c-3dfa-4dc6-8181-1c43928029bb None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:07.458749 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e670c2e-863f-43c3-ba23-f3a44cbbc2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:07.459402 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e670c2e-863f-43c3-ba23-f3a44cbbc2ff None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:07.459682 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e670c2e-863f-43c3-ba23-f3a44cbbc2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:07.459952 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e670c2e-863f-43c3-ba23-f3a44cbbc2ff None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:07.460617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e670c2e-863f-43c3-ba23-f3a44cbbc2ff None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:07.462232 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e670c2e-863f-43c3-ba23-f3a44cbbc2ff None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:07.471107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-7e670c2e-863f-43c3-ba23-f3a44cbbc2ff None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:19:07.471107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:07.471107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:19:07.471107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:19:07.471107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:19:07.471107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:19:07.471107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:19:07.471107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:07.471107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:19:07.471107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:07.471107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:07.471107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:07.471107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:07.471107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:07.471107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:07.471107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:07.471107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:07.472099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:07.472099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:07.472099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:07.472099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:07.472099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:07.472099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:07.472099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:19:07.472099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:19:07.472099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:19:07.472099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:19:07.472099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:07.472099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:07.472099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:07.472099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:07.472099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:07.472099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:07.472948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:07.472948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:07.472948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:07.472948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:07.472948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:07.472948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:07.472948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:07.472948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:07.472948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:07.472948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:07.472948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:19:07.472948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:07.472948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:19:07.472948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:07.472948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 409/823] 10.222.0.25 () {56 vars in 1129 bytes} [Sat Sep 24 19:19:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:07.473937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e670c2e-863f-43c3-ba23-f3a44cbbc2ff None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:07.482107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09eff6-fb59-4474-95f5-b2522c33fcc2 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:07.519625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2555c3d-abd9-4a31-8040-bb1dd01d03c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:07.521038 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2555c3d-abd9-4a31-8040-bb1dd01d03c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:07.521515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2555c3d-abd9-4a31-8040-bb1dd01d03c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:07.521974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2555c3d-abd9-4a31-8040-bb1dd01d03c9 None admin] PATH_INFO: `/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/7c398cf6318240f09d2c3b62bc6761d5/roles/a2673fe5628247c3a918eaa28d483e9f` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:07.539581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2555c3d-abd9-4a31-8040-bb1dd01d03c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f61085f09512451e92c9fa36fa9a8071, user_id=7c398cf6318240f09d2c3b62bc6761d5, role_id=a2673fe5628247c3a918eaa28d483e9f)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:07.541753 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2555c3d-abd9-4a31-8040-bb1dd01d03c9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:07.556928 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 415/824] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:19:07 2022] PUT /identity/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/7c398cf6318240f09d2c3b62bc6761d5/roles/a2673fe5628247c3a918eaa28d483e9f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:19:07.557725 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2555c3d-abd9-4a31-8040-bb1dd01d03c9 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:07.581133 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:07.597477 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e670c2e-863f-43c3-ba23-f3a44cbbc2ff None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:07.620200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:07.642183 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7900cc-572a-47f8-aba8-99f751747b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:07.643209 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7900cc-572a-47f8-aba8-99f751747b9d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:07.643673 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7900cc-572a-47f8-aba8-99f751747b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:07.644159 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7900cc-572a-47f8-aba8-99f751747b9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:07.657691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7900cc-572a-47f8-aba8-99f751747b9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:07.659518 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7900cc-572a-47f8-aba8-99f751747b9d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:07.678951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-ec7900cc-572a-47f8-aba8-99f751747b9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:07.678951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:07.678951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:07.678951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:07.678951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:07.678951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:07.678951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:07.678951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:07.678951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:07.678951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:07.678951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:07.678951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:07.678951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:07.678951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:07.678951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:07.678951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:07.680008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:07.680008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:07.680008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:07.680008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:07.680008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:07.680008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:07.680008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:07.680008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:07.680008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:07.680008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:07.680008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:07.680008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:07.680008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:07.680008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:07.680008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:07.680008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:07.680008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:07.681007 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:07.681007 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:07.681007 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:07.683252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 410/825] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:07.688608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7900cc-572a-47f8-aba8-99f751747b9d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:07.700940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2555c3d-abd9-4a31-8040-bb1dd01d03c9 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:07.742379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df684e0-ffea-45da-bd1a-f55898c09623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:07.743920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df684e0-ffea-45da-bd1a-f55898c09623 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:07.744249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df684e0-ffea-45da-bd1a-f55898c09623 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:07.744623 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df684e0-ffea-45da-bd1a-f55898c09623 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:07.745445 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df684e0-ffea-45da-bd1a-f55898c09623 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:07.745787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df684e0-ffea-45da-bd1a-f55898c09623 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:07.747641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df684e0-ffea-45da-bd1a-f55898c09623 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:07.753937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 416/826] 10.222.0.25 () {56 vars in 1124 bytes} [Sat Sep 24 19:19:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:07.759370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df684e0-ffea-45da-bd1a-f55898c09623 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:07.819505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7900cc-572a-47f8-aba8-99f751747b9d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:07.850074 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:07.870619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ecd33-328b-4081-b1eb-1b3663fe7e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:07.871523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ecd33-328b-4081-b1eb-1b3663fe7e87 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:07.872536 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ecd33-328b-4081-b1eb-1b3663fe7e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:07.872994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ecd33-328b-4081-b1eb-1b3663fe7e87 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:07.874080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ecd33-328b-4081-b1eb-1b3663fe7e87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:07.874811 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ecd33-328b-4081-b1eb-1b3663fe7e87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:07.877110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ecd33-328b-4081-b1eb-1b3663fe7e87 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:07.885484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df684e0-ffea-45da-bd1a-f55898c09623 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:07.893659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 411/827] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:07.899963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ecd33-328b-4081-b1eb-1b3663fe7e87 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:07.929326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d98d23-dc9f-447a-89fa-063cc713c75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:07.930503 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d98d23-dc9f-447a-89fa-063cc713c75a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:07.930994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d98d23-dc9f-447a-89fa-063cc713c75a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:07.931925 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d98d23-dc9f-447a-89fa-063cc713c75a None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:07.933083 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d98d23-dc9f-447a-89fa-063cc713c75a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:07.933721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:07.934067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d98d23-dc9f-447a-89fa-063cc713c75a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:07.936508 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d98d23-dc9f-447a-89fa-063cc713c75a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:07.943226 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 417/828] 10.222.0.25 () {56 vars in 1124 bytes} [Sat Sep 24 19:19:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:07.951549 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d98d23-dc9f-447a-89fa-063cc713c75a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:08.038758 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ecd33-328b-4081-b1eb-1b3663fe7e87 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:08.070460 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d98d23-dc9f-447a-89fa-063cc713c75a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:08.087853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132799f-3bdf-4c82-8767-63ab3febafa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:08.089126 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132799f-3bdf-4c82-8767-63ab3febafa2 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:08.090018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132799f-3bdf-4c82-8767-63ab3febafa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:08.090493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132799f-3bdf-4c82-8767-63ab3febafa2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:08.100552 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132799f-3bdf-4c82-8767-63ab3febafa2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:08.103153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132799f-3bdf-4c82-8767-63ab3febafa2 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:08.107537 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c71c5-8990-43cb-a28a-efb9ba33726b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:08.108152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c71c5-8990-43cb-a28a-efb9ba33726b None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:08.108432 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c71c5-8990-43cb-a28a-efb9ba33726b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:08.108706 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c71c5-8990-43cb-a28a-efb9ba33726b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:08.109378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c71c5-8990-43cb-a28a-efb9ba33726b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:08.110734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c71c5-8990-43cb-a28a-efb9ba33726b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:08.116941 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:08.121073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-0132799f-3bdf-4c82-8767-63ab3febafa2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:08.121073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:08.121073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:08.121073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:08.121073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:08.121073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:08.121073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:08.121073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:08.121073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:08.121073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:08.121073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:08.121073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:08.121073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:19:08.121073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:19:08.121073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:19:08.122119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:19:08.122119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:08.122119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:08.122119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:08.122119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:08.122119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:08.122119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:08.122119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:08.122119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:08.122119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:08.122119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:08.122119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:08.122119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:08.122119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:08.122119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:08.122119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:08.122119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:08.123217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:19:08.123217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:19:08.123217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:19:08.123217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:19:08.123217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:19:08.123217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:19:08.123217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:08.123217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:08.124071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 412/829] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:19:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:08.130201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132799f-3bdf-4c82-8767-63ab3febafa2 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:08.146879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 418/830] 10.222.0.25 () {60 vars in 1144 bytes} [Sat Sep 24 19:19:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:19:08.359936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:08.370750 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132799f-3bdf-4c82-8767-63ab3febafa2 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:08.422820 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befba7db-6f43-4439-b570-a43f74938dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:08.423792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befba7db-6f43-4439-b570-a43f74938dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:08.423792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befba7db-6f43-4439-b570-a43f74938dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:08.423939 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befba7db-6f43-4439-b570-a43f74938dd8 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:08.424612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befba7db-6f43-4439-b570-a43f74938dd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:08.425185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befba7db-6f43-4439-b570-a43f74938dd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:08.426613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befba7db-6f43-4439-b570-a43f74938dd8 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:08.442687 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 413/831] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:19:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:08.448910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c71c5-8990-43cb-a28a-efb9ba33726b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:08.563421 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c71c5-8990-43cb-a28a-efb9ba33726b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:08.598202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3cad5-76ee-4b53-893a-9df9858fc211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:08.598803 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3cad5-76ee-4b53-893a-9df9858fc211 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:08.599103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3cad5-76ee-4b53-893a-9df9858fc211 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:08.599364 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3cad5-76ee-4b53-893a-9df9858fc211 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:08.600070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3cad5-76ee-4b53-893a-9df9858fc211 None admin] RBAC: Adding query filter params (role.id=dd27845a836a4f6ebece149dbebc59c0, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=4e5798be0fa544cf9cf48558e87fcfa9) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:08.600368 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3cad5-76ee-4b53-893a-9df9858fc211 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:08.601884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3cad5-76ee-4b53-893a-9df9858fc211 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:08.608823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 419/832] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:19:08 2022] GET /identity/v3/role_assignments?user.id=4e5798be0fa544cf9cf48558e87fcfa9&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=dd27845a836a4f6ebece149dbebc59c0 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:08.646306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935adaa9-f30f-4287-b001-dd3c70f18a6f None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:08.647370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935adaa9-f30f-4287-b001-dd3c70f18a6f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:08.647849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935adaa9-f30f-4287-b001-dd3c70f18a6f None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:08.650084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 414/833] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:08.656187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052139fe-b89d-49a6-a3b1-0aa17a8fe36a None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:08.656547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052139fe-b89d-49a6-a3b1-0aa17a8fe36a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:08.656827 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052139fe-b89d-49a6-a3b1-0aa17a8fe36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:08.677452 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-052139fe-b89d-49a6-a3b1-0aa17a8fe36a None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:08.678572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-052139fe-b89d-49a6-a3b1-0aa17a8fe36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:08.737967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:08.757647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 420/834] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:09.028397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935adaa9-f30f-4287-b001-dd3c70f18a6f None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:09.138629 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935adaa9-f30f-4287-b001-dd3c70f18a6f None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:09.175417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ba160-423d-461b-8ac4-eaed6f2f535b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:09.176119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ba160-423d-461b-8ac4-eaed6f2f535b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:09.176394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ba160-423d-461b-8ac4-eaed6f2f535b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:09.176713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ba160-423d-461b-8ac4-eaed6f2f535b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:09.189293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ba160-423d-461b-8ac4-eaed6f2f535b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:19:09.194243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-880ba160-423d-461b-8ac4-eaed6f2f535b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:19:09.194243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:09.194243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:09.194243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:09.194243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:09.194243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:09.194243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:09.194243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:09.194243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:09.194243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:09.194243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:09.194243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:09.194243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:19:09.194243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:19:09.194243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:19:09.194243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:19:09.195220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:19:09.195220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:19:09.195220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:19:09.195220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:19:09.195220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:09.195220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:09.195220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:09.195220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:09.195220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:09.195220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:09.195220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:09.195220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:09.195220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:09.195220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:09.195220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:09.195220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:09.196644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:09.196644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:09.196644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:09.196644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:09.196644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:19:09.196644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:19:09.196644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:19:09.196644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:19:09.196644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:19:09.196644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:19:09.196644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:19:09.196644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:09.196644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 415/835] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:19:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:09.203763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052139fe-b89d-49a6-a3b1-0aa17a8fe36a None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:09.306776 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052139fe-b89d-49a6-a3b1-0aa17a8fe36a None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:09.342426 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60badff2-2cfa-4208-8712-cbac81cee427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:09.343433 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60badff2-2cfa-4208-8712-cbac81cee427 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:09.343915 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60badff2-2cfa-4208-8712-cbac81cee427 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:09.344385 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60badff2-2cfa-4208-8712-cbac81cee427 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:09.345257 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60badff2-2cfa-4208-8712-cbac81cee427 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:09.345771 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60badff2-2cfa-4208-8712-cbac81cee427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:09.347350 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60badff2-2cfa-4208-8712-cbac81cee427 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:09.356970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 421/836] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:19:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:09.363194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ba160-423d-461b-8ac4-eaed6f2f535b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:09.374903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:09.481345 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ba160-423d-461b-8ac4-eaed6f2f535b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:09.516535 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b744dbf-1fd3-4c9d-b94f-241e0cc78c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:09.517167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b744dbf-1fd3-4c9d-b94f-241e0cc78c11 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:09.517444 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b744dbf-1fd3-4c9d-b94f-241e0cc78c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:09.517710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b744dbf-1fd3-4c9d-b94f-241e0cc78c11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:09.529815 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b744dbf-1fd3-4c9d-b94f-241e0cc78c11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:09.531400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b744dbf-1fd3-4c9d-b94f-241e0cc78c11 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:09.546073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-2b744dbf-1fd3-4c9d-b94f-241e0cc78c11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:09.546073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:09.546073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:09.546073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:09.546073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:09.546073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:09.546073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:09.546073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:09.546073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:09.546073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:09.546073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:09.546073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:09.546073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:09.546073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:09.546073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:09.546073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:09.547077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:09.547077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:09.547077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:09.547077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:09.547077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:09.547077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:09.547077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:09.547077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:09.547077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:09.547077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:09.547077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:09.547077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:09.547077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:09.547077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:09.547077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:09.547077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:09.547077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:09.547987 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:09.547987 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:09.547987 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:09.547987 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 416/837] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:09.554335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60badff2-2cfa-4208-8712-cbac81cee427 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:09.609173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:09.663072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60badff2-2cfa-4208-8712-cbac81cee427 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:09.697428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef73bf4-c161-437e-a0ab-c8b9f6ec4ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:09.698398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef73bf4-c161-437e-a0ab-c8b9f6ec4ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:09.698905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef73bf4-c161-437e-a0ab-c8b9f6ec4ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:09.699376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef73bf4-c161-437e-a0ab-c8b9f6ec4ae2 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:09.700206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef73bf4-c161-437e-a0ab-c8b9f6ec4ae2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:09.700747 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef73bf4-c161-437e-a0ab-c8b9f6ec4ae2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:09.702310 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef73bf4-c161-437e-a0ab-c8b9f6ec4ae2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:09.715888 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 422/838] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:09.721890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b744dbf-1fd3-4c9d-b94f-241e0cc78c11 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:09.789973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:09.838623 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b744dbf-1fd3-4c9d-b94f-241e0cc78c11 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:09.845223 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1081d-55c7-4502-8cfd-7df62fec176d None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:09.845505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1081d-55c7-4502-8cfd-7df62fec176d None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:09.845778 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1081d-55c7-4502-8cfd-7df62fec176d None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:09.847435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 423/839] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:19:09.852571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265abd72-78de-4e19-ae64-1bbb4f4d9b1d None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:09.853048 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265abd72-78de-4e19-ae64-1bbb4f4d9b1d None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:09.853507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265abd72-78de-4e19-ae64-1bbb4f4d9b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:09.872251 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-265abd72-78de-4e19-ae64-1bbb4f4d9b1d None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:09.873709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-265abd72-78de-4e19-ae64-1bbb4f4d9b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:09.874305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6c4d9-e322-46a0-91b1-d3dea8739538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:09.875011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6c4d9-e322-46a0-91b1-d3dea8739538 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:09.875294 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6c4d9-e322-46a0-91b1-d3dea8739538 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:09.875569 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6c4d9-e322-46a0-91b1-d3dea8739538 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:09.885192 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6c4d9-e322-46a0-91b1-d3dea8739538 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:09.886802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6c4d9-e322-46a0-91b1-d3dea8739538 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:09.898993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-4ea6c4d9-e322-46a0-91b1-d3dea8739538 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:19:09.898993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:09.898993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:09.898993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:09.898993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:09.898993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:09.898993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:09.898993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:09.898993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:09.898993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:09.898993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:09.898993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:09.898993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:19:09.898993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:19:09.898993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:19:09.898993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:19:09.900093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:09.900093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:09.900093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:19:09.900093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:09.900093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:19:09.900093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:09.900093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:09.900093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:09.900093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:09.900093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:09.900093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:09.900093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:09.900093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:09.900093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:09.900093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:09.900093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:09.900093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:09.900093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:09.901158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:09.901158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:09.901158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:19:09.901158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:19:09.901158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:19:09.901158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:19:09.901158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:19:09.901158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:19:09.901158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 19:19:09.901158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:09.901158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 417/840] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:19:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:09.907896 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6c4d9-e322-46a0-91b1-d3dea8739538 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:09.970865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 424/841] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:19:10.022141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6c4d9-e322-46a0-91b1-d3dea8739538 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:10.041221 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:10.061202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fc001-a829-4722-ac7b-949ee9770dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:10.063107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fc001-a829-4722-ac7b-949ee9770dcc None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:10.063107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fc001-a829-4722-ac7b-949ee9770dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:10.063107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fc001-a829-4722-ac7b-949ee9770dcc None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:10.063486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fc001-a829-4722-ac7b-949ee9770dcc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:10.065172 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fc001-a829-4722-ac7b-949ee9770dcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:10.065587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fc001-a829-4722-ac7b-949ee9770dcc None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:10.085677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 418/842] 10.222.0.25 () {56 vars in 1135 bytes} [Sat Sep 24 19:19:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:10.091819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265abd72-78de-4e19-ae64-1bbb4f4d9b1d None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:10.135574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:10.200475 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265abd72-78de-4e19-ae64-1bbb4f4d9b1d None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:10.235871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3669f-1438-48d0-96c2-dc13d20331ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:10.236479 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3669f-1438-48d0-96c2-dc13d20331ef None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:10.236753 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3669f-1438-48d0-96c2-dc13d20331ef None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:10.237021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3669f-1438-48d0-96c2-dc13d20331ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:10.250781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fc001-a829-4722-ac7b-949ee9770dcc None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:10.325896 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3669f-1438-48d0-96c2-dc13d20331ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:10.327389 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3669f-1438-48d0-96c2-dc13d20331ef None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:10.370819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:10.382734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fc001-a829-4722-ac7b-949ee9770dcc None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:10.430710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120e19b-b9b1-40be-b771-75dff2fa00dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:10.431848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120e19b-b9b1-40be-b771-75dff2fa00dc None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:10.432050 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120e19b-b9b1-40be-b771-75dff2fa00dc None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:10.432277 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120e19b-b9b1-40be-b771-75dff2fa00dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:10.445127 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120e19b-b9b1-40be-b771-75dff2fa00dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:19:10.450716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-5120e19b-b9b1-40be-b771-75dff2fa00dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:19:10.450716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:10.450716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:10.450716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:10.450716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:10.450716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:10.450716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:10.450716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:10.450716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:10.450716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:10.450716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:10.450716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:10.450716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:19:10.450716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:19:10.450716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:19:10.450716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:19:10.451798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:19:10.451798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:19:10.451798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:19:10.451798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:19:10.451798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:10.451798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:10.451798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:10.451798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:10.451798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:10.451798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:10.451798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:10.451798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:10.451798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:10.451798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:10.451798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:10.451798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:10.452650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:10.452650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:10.452650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:10.452650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:10.452650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:19:10.452650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:19:10.452650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:19:10.452650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:19:10.452650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:19:10.452650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:19:10.452650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:19:10.452650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:10.457068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 419/843] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:19:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:10.458047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120e19b-b9b1-40be-b771-75dff2fa00dc None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:10.469934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 425/844] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:19:10 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 19:19:10.471288 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3669f-1438-48d0-96c2-dc13d20331ef None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:10.498565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:10.567153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120e19b-b9b1-40be-b771-75dff2fa00dc None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:10.601621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3669f-1438-48d0-96c2-dc13d20331ef None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:10.603245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714bbcb-a7bc-4e76-8c45-6bfa879c7335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:10.603856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714bbcb-a7bc-4e76-8c45-6bfa879c7335 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:10.604134 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714bbcb-a7bc-4e76-8c45-6bfa879c7335 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:10.604406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714bbcb-a7bc-4e76-8c45-6bfa879c7335 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:10.605341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714bbcb-a7bc-4e76-8c45-6bfa879c7335 None admin] RBAC: Adding query filter params (name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:10.605341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714bbcb-a7bc-4e76-8c45-6bfa879c7335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:10.606710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714bbcb-a7bc-4e76-8c45-6bfa879c7335 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:10.619700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 420/845] 10.222.0.25 () {56 vars in 1103 bytes} [Sat Sep 24 19:19:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:10.619700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848abca-384f-493a-a09e-c0aafa488173 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:10.619700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848abca-384f-493a-a09e-c0aafa488173 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:10.619700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848abca-384f-493a-a09e-c0aafa488173 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:10.619700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 421/846] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:10.621392 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848abca-384f-493a-a09e-c0aafa488173 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:10.645954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f8b78-35e8-4688-9372-f90d8d88d35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:10.646880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f8b78-35e8-4688-9372-f90d8d88d35d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:10.647162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f8b78-35e8-4688-9372-f90d8d88d35d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:10.647434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f8b78-35e8-4688-9372-f90d8d88d35d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:10.655907 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:10.660617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f8b78-35e8-4688-9372-f90d8d88d35d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:10.661442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f8b78-35e8-4688-9372-f90d8d88d35d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:10.676845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-dd8f8b78-35e8-4688-9372-f90d8d88d35d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:10.676845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:10.676845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:10.676845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:10.676845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:10.676845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:10.676845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:10.676845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:10.676845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:10.676845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:10.676845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:10.676845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:10.676845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:10.676845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:10.676845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:10.676845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:10.677795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:10.677795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:10.677795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:10.677795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:10.677795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:10.677795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:10.677795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:10.677795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:10.677795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:10.677795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:10.677795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:10.677795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:10.677795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:10.677795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:10.677795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:10.677795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:10.677795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:10.678712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:10.678712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:10.678712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:10.678712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 426/847] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:10.679744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5670e7b-5bea-4ea8-b7b5-254c9bab377a None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:10.679744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5670e7b-5bea-4ea8-b7b5-254c9bab377a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:10.679744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5670e7b-5bea-4ea8-b7b5-254c9bab377a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:10.699043 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-f5670e7b-5bea-4ea8-b7b5-254c9bab377a None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:10.700330 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f5670e7b-5bea-4ea8-b7b5-254c9bab377a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:10.729310 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:10.735574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848abca-384f-493a-a09e-c0aafa488173 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:10.770845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a079d-65b0-4cae-b04d-8620cdf224e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:10.771502 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a079d-65b0-4cae-b04d-8620cdf224e4 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:10.771984 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a079d-65b0-4cae-b04d-8620cdf224e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:10.772094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a079d-65b0-4cae-b04d-8620cdf224e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:10.786858 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 427/848] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:10.786858 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5670e7b-5bea-4ea8-b7b5-254c9bab377a None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:10.792572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a079d-65b0-4cae-b04d-8620cdf224e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:10.794650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a079d-65b0-4cae-b04d-8620cdf224e4 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:10.812151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-f59a079d-65b0-4cae-b04d-8620cdf224e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:10.812151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:10.812151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:10.812151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:10.812151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:10.812151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:10.812151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:10.812151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:10.812151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:10.812151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:10.812151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:10.812151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:10.812151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:10.812151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:10.812151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:10.812151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:10.813139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:10.813139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:10.813139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:10.813139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:10.813139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:10.813139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:10.813139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:10.813139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:10.813139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:10.813139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:10.813139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:10.813139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:10.813139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:10.813139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:10.813139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:10.813139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:10.813139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:10.814669 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:10.814669 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:10.814669 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:10.814669 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 422/849] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:10.818699 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a079d-65b0-4cae-b04d-8620cdf224e4 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:10.911953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5670e7b-5bea-4ea8-b7b5-254c9bab377a None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:10.939384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a079d-65b0-4cae-b04d-8620cdf224e4 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:10.939680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:10.959041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb93854-0e03-4a48-9cf9-1f231041644e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:10.959692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb93854-0e03-4a48-9cf9-1f231041644e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:10.960442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb93854-0e03-4a48-9cf9-1f231041644e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:10.960721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb93854-0e03-4a48-9cf9-1f231041644e None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:10.961926 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb93854-0e03-4a48-9cf9-1f231041644e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:10.962244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb93854-0e03-4a48-9cf9-1f231041644e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:10.964500 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb93854-0e03-4a48-9cf9-1f231041644e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:10.973654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd597cc7-3cf9-4aeb-8fe5-99813a37ab79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:10.974264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd597cc7-3cf9-4aeb-8fe5-99813a37ab79 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:10.974540 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd597cc7-3cf9-4aeb-8fe5-99813a37ab79 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:10.974861 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd597cc7-3cf9-4aeb-8fe5-99813a37ab79 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:10.975470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd597cc7-3cf9-4aeb-8fe5-99813a37ab79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:10.975770 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd597cc7-3cf9-4aeb-8fe5-99813a37ab79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:10.977003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 428/850] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:10.978715 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29be29-c707-4efb-823f-8d2b90e72b65 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:10.979035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29be29-c707-4efb-823f-8d2b90e72b65 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:10.979313 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29be29-c707-4efb-823f-8d2b90e72b65 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:10.980626 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 429/851] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:10.981994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd597cc7-3cf9-4aeb-8fe5-99813a37ab79 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:10.983857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29be29-c707-4efb-823f-8d2b90e72b65 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:10.994271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 423/852] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:10.995779 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb8ec3-7e97-4d06-a3c0-513d7a40840a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:10.995779 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb8ec3-7e97-4d06-a3c0-513d7a40840a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:10.996041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb8ec3-7e97-4d06-a3c0-513d7a40840a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:11.013514 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-d5fb8ec3-7e97-4d06-a3c0-513d7a40840a None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:11.014762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d5fb8ec3-7e97-4d06-a3c0-513d7a40840a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:11.018449 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:11.088761 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 424/853] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:11.089886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb8ec3-7e97-4d06-a3c0-513d7a40840a None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:11.108931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29be29-c707-4efb-823f-8d2b90e72b65 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:11.145318 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe68c5-79a8-4530-80aa-b5e8dc83fb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:11.145942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe68c5-79a8-4530-80aa-b5e8dc83fb75 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:11.146222 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe68c5-79a8-4530-80aa-b5e8dc83fb75 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:11.146490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe68c5-79a8-4530-80aa-b5e8dc83fb75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:11.153895 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe68c5-79a8-4530-80aa-b5e8dc83fb75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:11.155375 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe68c5-79a8-4530-80aa-b5e8dc83fb75 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:11.166935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-85fe68c5-79a8-4530-80aa-b5e8dc83fb75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:11.166935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:11.166935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:11.166935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:11.166935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:11.166935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:11.166935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:11.166935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:11.166935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:11.166935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:11.166935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:11.166935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:11.166935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:19:11.166935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:19:11.166935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:19:11.167893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:19:11.167893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:11.167893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:11.167893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:11.167893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:11.167893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:11.167893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:11.167893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:11.167893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:11.167893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:11.167893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:11.167893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:11.167893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:11.167893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:11.167893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:11.167893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:11.167893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:11.168802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:19:11.168802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:19:11.168802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:19:11.168802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:19:11.168802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:19:11.168802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:19:11.168802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:11.168802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:11.168802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 430/854] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:19:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:11.169291 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe68c5-79a8-4530-80aa-b5e8dc83fb75 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:11.203102 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb8ec3-7e97-4d06-a3c0-513d7a40840a None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:11.216538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:11.240517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d83636-5e0a-4b5f-84c3-d5cc9c9d449e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:11.241273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d83636-5e0a-4b5f-84c3-d5cc9c9d449e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:11.241555 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d83636-5e0a-4b5f-84c3-d5cc9c9d449e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:11.241831 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d83636-5e0a-4b5f-84c3-d5cc9c9d449e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:11.250456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d83636-5e0a-4b5f-84c3-d5cc9c9d449e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:11.251924 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d83636-5e0a-4b5f-84c3-d5cc9c9d449e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:11.254623 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:11.265332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-e1d83636-5e0a-4b5f-84c3-d5cc9c9d449e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:19:11.265332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:11.265332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:11.265332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:11.265332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:11.265332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:11.265332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:11.265332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:11.265332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:11.265332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:11.265332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:11.265332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:11.265332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:19:11.265332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:19:11.265332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:19:11.265332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:19:11.266326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:11.266326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:11.266326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:19:11.266326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:11.266326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:19:11.266326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:11.266326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:11.266326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:11.266326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:11.266326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:11.266326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:11.266326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:11.266326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:11.266326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:11.266326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:11.266326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:11.266326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:11.266326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:11.267316 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:11.267316 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:11.267316 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:19:11.267316 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:19:11.267316 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:19:11.267316 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:19:11.267316 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:19:11.267316 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:19:11.267316 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:19:11.267316 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:11.271309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 425/855] 10.222.0.25 () {56 vars in 1117 bytes} [Sat Sep 24 19:19:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:11.271975 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d83636-5e0a-4b5f-84c3-d5cc9c9d449e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:11.281814 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe68c5-79a8-4530-80aa-b5e8dc83fb75 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:11.318243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bda634-2512-494e-b680-d9575be3ba1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:11.318958 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bda634-2512-494e-b680-d9575be3ba1d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:11.319236 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bda634-2512-494e-b680-d9575be3ba1d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:11.319509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bda634-2512-494e-b680-d9575be3ba1d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:11.320198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bda634-2512-494e-b680-d9575be3ba1d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:11.321687 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bda634-2512-494e-b680-d9575be3ba1d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:11.330695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-02bda634-2512-494e-b680-d9575be3ba1d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:19:11.330695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:11.330695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:19:11.330695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:19:11.330695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:19:11.330695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:19:11.330695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:19:11.330695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:11.330695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:19:11.330695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:11.330695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:11.330695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:11.330695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:11.330695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:11.330695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:11.330695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:11.330695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:11.331789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:11.331789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:11.331789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:11.331789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:11.331789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:11.331789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:11.331789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:19:11.331789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:19:11.331789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:19:11.331789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:19:11.331789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:11.331789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:11.331789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:11.331789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:11.331789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:11.331789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:11.335800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:11.335800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:11.335800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:11.335800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:11.335800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:11.335800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:11.335800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:11.335800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:11.335800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:11.335800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:11.335800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:19:11.335800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:11.335800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:19:11.335800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:11.335800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 431/856] 10.222.0.25 () {56 vars in 1114 bytes} [Sat Sep 24 19:19:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:11.337112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bda634-2512-494e-b680-d9575be3ba1d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:11.386059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d83636-5e0a-4b5f-84c3-d5cc9c9d449e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:11.424036 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7751f0e-3e4d-4dfe-9865-59213bfd7475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:11.424652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7751f0e-3e4d-4dfe-9865-59213bfd7475 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:11.424934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7751f0e-3e4d-4dfe-9865-59213bfd7475 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:11.425207 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7751f0e-3e4d-4dfe-9865-59213bfd7475 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:11.425904 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7751f0e-3e4d-4dfe-9865-59213bfd7475 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:11.426209 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7751f0e-3e4d-4dfe-9865-59213bfd7475 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:11.427677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7751f0e-3e4d-4dfe-9865-59213bfd7475 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:11.437712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bda634-2512-494e-b680-d9575be3ba1d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:11.439775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 426/857] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:19:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:11.440184 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:11.440410 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7751f0e-3e4d-4dfe-9865-59213bfd7475 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:11.477407 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085d242-9121-433a-b442-fc246e05d5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:11.478094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085d242-9121-433a-b442-fc246e05d5d6 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:11.478372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085d242-9121-433a-b442-fc246e05d5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:11.478639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085d242-9121-433a-b442-fc246e05d5d6 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:11.479385 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085d242-9121-433a-b442-fc246e05d5d6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:11.479687 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085d242-9121-433a-b442-fc246e05d5d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:11.481097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085d242-9121-433a-b442-fc246e05d5d6 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:11.497634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 432/858] 10.222.0.25 () {56 vars in 1149 bytes} [Sat Sep 24 19:19:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:11.498429 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085d242-9121-433a-b442-fc246e05d5d6 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:11.502982 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:11.541696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7751f0e-3e4d-4dfe-9865-59213bfd7475 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:11.576184 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1f80f-c405-4cac-94b5-dc9cee7dd905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:11.576790 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1f80f-c405-4cac-94b5-dc9cee7dd905 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:11.577063 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1f80f-c405-4cac-94b5-dc9cee7dd905 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:11.577334 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1f80f-c405-4cac-94b5-dc9cee7dd905 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:11.577959 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1f80f-c405-4cac-94b5-dc9cee7dd905 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:11.578264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1f80f-c405-4cac-94b5-dc9cee7dd905 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:11.579647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f1f80f-c405-4cac-94b5-dc9cee7dd905 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:11.584113 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 427/859] 10.222.0.25 () {56 vars in 1114 bytes} [Sat Sep 24 19:19:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:11.584891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1f80f-c405-4cac-94b5-dc9cee7dd905 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:11.596410 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085d242-9121-433a-b442-fc246e05d5d6 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:11.629459 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdaf2c-eb01-4077-b4de-3b9318f6b3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:11.630082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdaf2c-eb01-4077-b4de-3b9318f6b3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:11.630360 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdaf2c-eb01-4077-b4de-3b9318f6b3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:11.630634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdaf2c-eb01-4077-b4de-3b9318f6b3b3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:11.631240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdaf2c-eb01-4077-b4de-3b9318f6b3b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:11.632602 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdaf2c-eb01-4077-b4de-3b9318f6b3b3 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:11.641890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-76bdaf2c-eb01-4077-b4de-3b9318f6b3b3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:19:11.641890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:11.641890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:19:11.641890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:19:11.641890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:19:11.641890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:19:11.641890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:19:11.641890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:11.641890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:19:11.641890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:11.641890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:11.641890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:11.641890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:11.641890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:11.641890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:11.641890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:11.643030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:11.643030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:11.643030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:11.643030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:11.643030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:11.643030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:11.643030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:11.643030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:19:11.643030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:19:11.643030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:19:11.643030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:19:11.643030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:11.643030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:11.643030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:11.643030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:11.643030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:11.643030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:11.644239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:11.644239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:11.644239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:11.644239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:11.644239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:11.644239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:11.644239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:11.644239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:11.644239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:11.644239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:11.644239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:19:11.644239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:11.644239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:19:11.644239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:11.644239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 433/860] 10.222.0.25 () {56 vars in 1132 bytes} [Sat Sep 24 19:19:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:11.645050 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdaf2c-eb01-4077-b4de-3b9318f6b3b3 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:11.675838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:11.689058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1f80f-c405-4cac-94b5-dc9cee7dd905 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:11.712622 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:11.724149 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea05cd3-9489-4558-9dd7-ef7a5e492cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:11.724751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea05cd3-9489-4558-9dd7-ef7a5e492cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:11.725031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea05cd3-9489-4558-9dd7-ef7a5e492cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:11.725304 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea05cd3-9489-4558-9dd7-ef7a5e492cf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:11.726019 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea05cd3-9489-4558-9dd7-ef7a5e492cf4 None admin] RBAC: Adding query filter params (role.id=dd27845a836a4f6ebece149dbebc59c0, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=85b45de73f7b4f7da7e0e8d8375deb37) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:11.726326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea05cd3-9489-4558-9dd7-ef7a5e492cf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:11.728519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea05cd3-9489-4558-9dd7-ef7a5e492cf4 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:11.734153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 428/861] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:19:11 2022] GET /identity/v3/role_assignments?user.id=85b45de73f7b4f7da7e0e8d8375deb37&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=dd27845a836a4f6ebece149dbebc59c0 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:11.734981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea05cd3-9489-4558-9dd7-ef7a5e492cf4 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:11.751260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdaf2c-eb01-4077-b4de-3b9318f6b3b3 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:11.791490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96047f8-2292-4c92-bbe3-a5b0d6bd0266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:11.792117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96047f8-2292-4c92-bbe3-a5b0d6bd0266 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:11.792395 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96047f8-2292-4c92-bbe3-a5b0d6bd0266 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:11.792665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96047f8-2292-4c92-bbe3-a5b0d6bd0266 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:11.849269 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea05cd3-9489-4558-9dd7-ef7a5e492cf4 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:11.873840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96047f8-2292-4c92-bbe3-a5b0d6bd0266 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:11.875371 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96047f8-2292-4c92-bbe3-a5b0d6bd0266 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:11.888171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af08c3d-da3f-4192-8a47-2b5965392c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:11.888792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af08c3d-da3f-4192-8a47-2b5965392c60 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:11.889075 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af08c3d-da3f-4192-8a47-2b5965392c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:11.889345 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af08c3d-da3f-4192-8a47-2b5965392c60 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:11.889981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af08c3d-da3f-4192-8a47-2b5965392c60 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:11.890284 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af08c3d-da3f-4192-8a47-2b5965392c60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:11.891698 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af08c3d-da3f-4192-8a47-2b5965392c60 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:11.907030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 429/862] 10.222.0.25 () {56 vars in 1114 bytes} [Sat Sep 24 19:19:11 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:11.907420 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:11.909221 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af08c3d-da3f-4192-8a47-2b5965392c60 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:11.986636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:12.010369 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 434/863] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:19:11 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:19:12.016121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96047f8-2292-4c92-bbe3-a5b0d6bd0266 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:12.071311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af08c3d-da3f-4192-8a47-2b5965392c60 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:12.118682 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00822d30-64d4-4cea-98ed-0b1fda121046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:12.119694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00822d30-64d4-4cea-98ed-0b1fda121046 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:12.120189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00822d30-64d4-4cea-98ed-0b1fda121046 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:12.120530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00822d30-64d4-4cea-98ed-0b1fda121046 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:12.121241 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00822d30-64d4-4cea-98ed-0b1fda121046 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:12.121618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00822d30-64d4-4cea-98ed-0b1fda121046 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:12.123154 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00822d30-64d4-4cea-98ed-0b1fda121046 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:12.135161 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 430/864] 10.222.0.25 () {56 vars in 1126 bytes} [Sat Sep 24 19:19:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:12.139873 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00822d30-64d4-4cea-98ed-0b1fda121046 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:12.150724 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96047f8-2292-4c92-bbe3-a5b0d6bd0266 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:12.183014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:12.192187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bae98-4246-4adc-add5-fffde9ac3f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:12.192728 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bae98-4246-4adc-add5-fffde9ac3f4b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:12.193016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bae98-4246-4adc-add5-fffde9ac3f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:12.193294 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bae98-4246-4adc-add5-fffde9ac3f4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:12.205457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905bae98-4246-4adc-add5-fffde9ac3f4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:12.207590 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905bae98-4246-4adc-add5-fffde9ac3f4b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:12.224543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-905bae98-4246-4adc-add5-fffde9ac3f4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:12.224543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:12.224543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:12.224543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:12.224543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:12.224543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:12.224543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:12.224543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:12.224543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:12.224543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:12.224543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:12.224543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:12.224543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:12.224543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:12.224543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:12.224543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:12.225553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:12.225553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:12.225553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:12.225553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:12.225553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:12.225553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:12.225553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:12.225553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:12.225553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:12.225553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:12.225553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:12.225553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:12.225553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:12.225553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:12.225553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:12.225553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:12.225553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:12.226443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:12.226443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:12.226443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:12.230984 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 435/865] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:12.233810 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bae98-4246-4adc-add5-fffde9ac3f4b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:12.259594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00822d30-64d4-4cea-98ed-0b1fda121046 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:12.277754 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:12.302519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddf0f4-63e2-46be-bc1e-5b9c4a1daa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:12.303552 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddf0f4-63e2-46be-bc1e-5b9c4a1daa1f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:12.304050 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddf0f4-63e2-46be-bc1e-5b9c4a1daa1f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:12.304525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddf0f4-63e2-46be-bc1e-5b9c4a1daa1f None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:12.306090 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddf0f4-63e2-46be-bc1e-5b9c4a1daa1f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:12.306864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddf0f4-63e2-46be-bc1e-5b9c4a1daa1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:12.309153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddf0f4-63e2-46be-bc1e-5b9c4a1daa1f None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:12.323102 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 431/866] 10.222.0.25 () {56 vars in 1126 bytes} [Sat Sep 24 19:19:12 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:12.364999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bae98-4246-4adc-add5-fffde9ac3f4b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:12.408042 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0509a4-2eca-4ce2-9d16-fde7cc08b466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:12.409052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0509a4-2eca-4ce2-9d16-fde7cc08b466 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:12.409574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0509a4-2eca-4ce2-9d16-fde7cc08b466 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:12.410064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0509a4-2eca-4ce2-9d16-fde7cc08b466 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:12.410955 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0509a4-2eca-4ce2-9d16-fde7cc08b466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:12.411487 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0509a4-2eca-4ce2-9d16-fde7cc08b466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:12.413100 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0509a4-2eca-4ce2-9d16-fde7cc08b466 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:12.427442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 436/867] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:12.433114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddf0f4-63e2-46be-bc1e-5b9c4a1daa1f None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:12.549630 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddf0f4-63e2-46be-bc1e-5b9c4a1daa1f None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:12.586195 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc972e63-5eff-4c58-8442-d37149041fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:12.587370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc972e63-5eff-4c58-8442-d37149041fcc None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:12.587645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc972e63-5eff-4c58-8442-d37149041fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:12.587910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc972e63-5eff-4c58-8442-d37149041fcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:12.595021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc972e63-5eff-4c58-8442-d37149041fcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:12.596519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc972e63-5eff-4c58-8442-d37149041fcc None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:12.608876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-cc972e63-5eff-4c58-8442-d37149041fcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:12.608876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:12.608876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:12.608876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:12.608876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:12.608876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:12.608876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:12.608876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:12.608876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:12.608876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:12.608876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:12.608876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:12.608876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:19:12.608876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:19:12.608876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:19:12.609799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:19:12.609799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:12.609799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:12.609799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:12.609799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:12.609799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:12.609799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:12.609799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:12.609799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:12.609799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:12.609799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:12.609799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:12.609799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:12.609799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:12.609799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:12.609799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:12.609799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:12.610698 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:19:12.610698 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:19:12.610698 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:19:12.610698 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:19:12.610698 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:19:12.610698 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:19:12.610698 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:12.610698 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:12.610698 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 432/868] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:19:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:12.615781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0509a4-2eca-4ce2-9d16-fde7cc08b466 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:12.661576 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:12.728685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0509a4-2eca-4ce2-9d16-fde7cc08b466 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:12.764607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c6eae-e405-4a6e-a37a-aa9b5f03f902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:12.765214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c6eae-e405-4a6e-a37a-aa9b5f03f902 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:12.765493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c6eae-e405-4a6e-a37a-aa9b5f03f902 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:12.765808 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c6eae-e405-4a6e-a37a-aa9b5f03f902 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:12.766550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c6eae-e405-4a6e-a37a-aa9b5f03f902 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:12.766888 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c6eae-e405-4a6e-a37a-aa9b5f03f902 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:12.768393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c6eae-e405-4a6e-a37a-aa9b5f03f902 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:12.784818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 437/869] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:19:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:12.790984 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc972e63-5eff-4c58-8442-d37149041fcc None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:12.834888 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:12.902294 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc972e63-5eff-4c58-8442-d37149041fcc None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:12.938569 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48ccce-cce5-4313-b581-8be519184975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:12.939206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48ccce-cce5-4313-b581-8be519184975 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:12.939487 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48ccce-cce5-4313-b581-8be519184975 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:12.939762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48ccce-cce5-4313-b581-8be519184975 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:12.940486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48ccce-cce5-4313-b581-8be519184975 None admin] RBAC: Adding query filter params (role.id=a2673fe5628247c3a918eaa28d483e9f, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=7c398cf6318240f09d2c3b62bc6761d5) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:12.940794 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48ccce-cce5-4313-b581-8be519184975 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:12.942215 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48ccce-cce5-4313-b581-8be519184975 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:12.948524 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 433/870] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:19:12 2022] GET /identity/v3/role_assignments?user.id=7c398cf6318240f09d2c3b62bc6761d5&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=a2673fe5628247c3a918eaa28d483e9f => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:14.005450 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965b1db-bb95-4a22-8987-02cbc1475514 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:14.005973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965b1db-bb95-4a22-8987-02cbc1475514 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:14.005973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965b1db-bb95-4a22-8987-02cbc1475514 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:14.007508 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 438/871] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:14.013281 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e9565-4e34-497b-b8ed-039c4016f536 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:14.014078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e9565-4e34-497b-b8ed-039c4016f536 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:14.014554 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e9565-4e34-497b-b8ed-039c4016f536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:14.034967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-a98e9565-4e34-497b-b8ed-039c4016f536 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:14.036575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a98e9565-4e34-497b-b8ed-039c4016f536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:14.114933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 434/872] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:14.160324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63de7fe-990b-46d9-a2a4-07514d3e8965 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:14.160631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63de7fe-990b-46d9-a2a4-07514d3e8965 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:14.160866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63de7fe-990b-46d9-a2a4-07514d3e8965 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:14.162433 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 439/873] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:14.167848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b1d4b-2cb1-4418-a4e7-7f7765cbbf66 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:14.168184 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b1d4b-2cb1-4418-a4e7-7f7765cbbf66 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:14.168460 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b1d4b-2cb1-4418-a4e7-7f7765cbbf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:14.187166 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-148b1d4b-2cb1-4418-a4e7-7f7765cbbf66 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:14.188337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-148b1d4b-2cb1-4418-a4e7-7f7765cbbf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:14.215608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:14.257588 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 435/874] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:14.401815 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63de7fe-990b-46d9-a2a4-07514d3e8965 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:14.515399 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:14.520738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63de7fe-990b-46d9-a2a4-07514d3e8965 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:14.534147 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b1d4b-2cb1-4418-a4e7-7f7765cbbf66 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:14.564540 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f258bfe-519f-40b4-a1dd-3e52afc3aae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:14.565626 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f258bfe-519f-40b4-a1dd-3e52afc3aae6 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:14.566181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f258bfe-519f-40b4-a1dd-3e52afc3aae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:14.566461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f258bfe-519f-40b4-a1dd-3e52afc3aae6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:14.567073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f258bfe-519f-40b4-a1dd-3e52afc3aae6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:14.568737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f258bfe-519f-40b4-a1dd-3e52afc3aae6 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:14.579879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-9f258bfe-519f-40b4-a1dd-3e52afc3aae6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:19:14.579879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:14.579879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:19:14.579879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:19:14.579879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:19:14.579879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:19:14.579879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:19:14.579879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:14.579879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:19:14.579879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:14.579879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:14.579879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:14.579879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:14.579879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:14.579879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:14.579879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:14.579879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:14.580988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:14.580988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:14.580988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:14.580988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:14.580988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:14.580988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:14.580988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:19:14.580988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:19:14.580988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:19:14.580988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:19:14.580988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:14.580988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:14.580988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:14.580988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:14.580988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:14.580988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:14.581914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:14.581914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:14.581914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:14.581914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:14.581914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:14.581914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:14.581914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:14.581914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:14.581914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:14.581914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:14.581914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:19:14.581914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:14.581914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:19:14.581914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:14.582706 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 440/875] 10.222.0.25 () {56 vars in 1126 bytes} [Sat Sep 24 19:19:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:14.587573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f258bfe-519f-40b4-a1dd-3e52afc3aae6 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:14.646051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b1d4b-2cb1-4418-a4e7-7f7765cbbf66 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:14.684906 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7fd3b-3a07-4d24-808e-3371030026ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:14.685674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7fd3b-3a07-4d24-808e-3371030026ff None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:14.685953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7fd3b-3a07-4d24-808e-3371030026ff None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:14.686218 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7fd3b-3a07-4d24-808e-3371030026ff None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:14.686927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7fd3b-3a07-4d24-808e-3371030026ff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:14.688279 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7fd3b-3a07-4d24-808e-3371030026ff None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:14.704292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 436/876] 10.222.0.25 () {60 vars in 1141 bytes} [Sat Sep 24 19:19:14 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:19:14.708359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eecfde-728f-4eb9-b082-9c1acc38df69 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:14.708656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eecfde-728f-4eb9-b082-9c1acc38df69 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:14.709002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eecfde-728f-4eb9-b082-9c1acc38df69 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:14.710552 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 437/877] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:14.716841 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7c090-e317-41d5-835f-06458b3a4223 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:14.717235 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7c090-e317-41d5-835f-06458b3a4223 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:14.717402 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7c090-e317-41d5-835f-06458b3a4223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:14.725526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f258bfe-519f-40b4-a1dd-3e52afc3aae6 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:14.738247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-2cb7c090-e317-41d5-835f-06458b3a4223 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:14.739523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2cb7c090-e317-41d5-835f-06458b3a4223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:14.761554 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:14.785324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a46b4-12e0-4ee8-ad60-dc075b80e044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:14.786324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a46b4-12e0-4ee8-ad60-dc075b80e044 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:14.786871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a46b4-12e0-4ee8-ad60-dc075b80e044 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:14.787693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a46b4-12e0-4ee8-ad60-dc075b80e044 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:14.789690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a46b4-12e0-4ee8-ad60-dc075b80e044 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:14.790343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a46b4-12e0-4ee8-ad60-dc075b80e044 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:14.792064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a46b4-12e0-4ee8-ad60-dc075b80e044 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:14.800765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 441/878] 10.222.0.25 () {56 vars in 1122 bytes} [Sat Sep 24 19:19:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:14.806879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a46b4-12e0-4ee8-ad60-dc075b80e044 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:14.836167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 438/879] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:14 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:14.851226 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:14.931169 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a46b4-12e0-4ee8-ad60-dc075b80e044 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:14.968023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e7a57-9695-49a7-a6b0-7062cbad5dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:14.968636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e7a57-9695-49a7-a6b0-7062cbad5dcf None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:14.968920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e7a57-9695-49a7-a6b0-7062cbad5dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:14.969189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e7a57-9695-49a7-a6b0-7062cbad5dcf None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:14.969812 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e7a57-9695-49a7-a6b0-7062cbad5dcf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:14.970112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e7a57-9695-49a7-a6b0-7062cbad5dcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:14.971501 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e7a57-9695-49a7-a6b0-7062cbad5dcf None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:14.976396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 442/880] 10.222.0.25 () {56 vars in 1122 bytes} [Sat Sep 24 19:19:14 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:15.121156 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7c090-e317-41d5-835f-06458b3a4223 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:15.235855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7c090-e317-41d5-835f-06458b3a4223 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:15.273356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381dd0cc-2567-461b-bd0b-2bfde83c14f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:15.275184 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dd0cc-2567-461b-bd0b-2bfde83c14f3 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:15.275692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dd0cc-2567-461b-bd0b-2bfde83c14f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:15.276176 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dd0cc-2567-461b-bd0b-2bfde83c14f3 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:15.277038 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381dd0cc-2567-461b-bd0b-2bfde83c14f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:15.278615 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381dd0cc-2567-461b-bd0b-2bfde83c14f3 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:15.296850 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 439/881] 10.222.0.25 () {60 vars in 1141 bytes} [Sat Sep 24 19:19:15 2022] POST /identity/v3/services => generated 269 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:19:15.320049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b035e-561c-4b95-8d9d-d6a19078a294 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:15.320596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b035e-561c-4b95-8d9d-d6a19078a294 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:15.320596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b035e-561c-4b95-8d9d-d6a19078a294 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:15.322784 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 443/882] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:15.328950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4a0f2-c160-4951-ab90-75d7212acc68 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:15.329284 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4a0f2-c160-4951-ab90-75d7212acc68 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:15.329516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4a0f2-c160-4951-ab90-75d7212acc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:15.349649 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-84a4a0f2-c160-4951-ab90-75d7212acc68 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:15.350942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-84a4a0f2-c160-4951-ab90-75d7212acc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:15.365101 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:15.443301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 440/883] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:15 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:19:15.715057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b035e-561c-4b95-8d9d-d6a19078a294 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:15.804028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:15.820650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b035e-561c-4b95-8d9d-d6a19078a294 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:15.856413 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3088c-737e-427f-a54a-7f4a078af30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:15.857036 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3088c-737e-427f-a54a-7f4a078af30a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:15.857315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3088c-737e-427f-a54a-7f4a078af30a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:15.857583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3088c-737e-427f-a54a-7f4a078af30a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:15.867796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3088c-737e-427f-a54a-7f4a078af30a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:19:15.872774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-9cd3088c-737e-427f-a54a-7f4a078af30a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:19:15.872774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:15.872774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:15.872774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:15.872774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:15.872774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:15.872774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:15.872774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:15.872774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:15.872774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:15.872774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:15.872774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:15.872774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:19:15.872774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:19:15.872774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:19:15.872774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:19:15.873764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:19:15.873764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:19:15.873764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:19:15.873764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:19:15.873764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:15.873764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:15.873764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:15.873764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:15.873764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:15.873764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:15.873764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:15.873764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:15.873764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:15.873764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:15.873764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:15.873764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:15.874768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:15.874768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:15.874768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:15.874768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:15.874768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:19:15.874768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:19:15.874768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:19:15.874768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:19:15.874768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:19:15.874768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:19:15.874768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:19:15.874768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:15.874768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 444/884] 10.222.0.25 () {56 vars in 1120 bytes} [Sat Sep 24 19:19:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:15.881937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4a0f2-c160-4951-ab90-75d7212acc68 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:15.986746 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4a0f2-c160-4951-ab90-75d7212acc68 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:16.022231 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0758d6-bc14-4f39-8811-55d02dbcc902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:16.023211 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0758d6-bc14-4f39-8811-55d02dbcc902 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:16.023956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0758d6-bc14-4f39-8811-55d02dbcc902 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:16.025195 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0758d6-bc14-4f39-8811-55d02dbcc902 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:16.026066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0758d6-bc14-4f39-8811-55d02dbcc902 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:16.026606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0758d6-bc14-4f39-8811-55d02dbcc902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:16.028188 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0758d6-bc14-4f39-8811-55d02dbcc902 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:16.040705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 441/885] 10.222.0.25 () {56 vars in 1115 bytes} [Sat Sep 24 19:19:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:16.043275 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3088c-737e-427f-a54a-7f4a078af30a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:16.151528 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3088c-737e-427f-a54a-7f4a078af30a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:16.186909 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bde0f-d116-4faf-a0be-b3e3bbddce5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:16.187542 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bde0f-d116-4faf-a0be-b3e3bbddce5f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:16.187822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bde0f-d116-4faf-a0be-b3e3bbddce5f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:16.188093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9bde0f-d116-4faf-a0be-b3e3bbddce5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:16.200714 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9bde0f-d116-4faf-a0be-b3e3bbddce5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:16.202139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9bde0f-d116-4faf-a0be-b3e3bbddce5f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:16.208935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:16.217661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-7f9bde0f-d116-4faf-a0be-b3e3bbddce5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:16.217661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:16.217661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:16.217661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:16.217661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:16.217661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:16.217661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:16.217661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:16.217661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:16.217661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:16.217661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:16.217661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:16.217661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:16.217661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:16.217661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:16.217661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:16.218970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:16.218970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:16.218970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:16.218970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:16.218970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:16.218970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:16.218970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:16.218970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:16.218970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:16.218970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:16.218970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:16.218970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:16.218970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:16.218970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:16.218970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:16.218970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:16.218970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:16.219878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:16.219878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:16.219878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:16.219878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 445/886] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:16.227991 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0758d6-bc14-4f39-8811-55d02dbcc902 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:16.235120 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:16.345025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0758d6-bc14-4f39-8811-55d02dbcc902 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:16.380160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ed9ad-47e2-428b-96a6-a471a7ecbfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:16.380769 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ed9ad-47e2-428b-96a6-a471a7ecbfc6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:16.381052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ed9ad-47e2-428b-96a6-a471a7ecbfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:16.381327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ed9ad-47e2-428b-96a6-a471a7ecbfc6 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:16.381965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ed9ad-47e2-428b-96a6-a471a7ecbfc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:16.382269 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ed9ad-47e2-428b-96a6-a471a7ecbfc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:16.384215 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ed9ad-47e2-428b-96a6-a471a7ecbfc6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:16.396696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 442/887] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:16.402919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bde0f-d116-4faf-a0be-b3e3bbddce5f None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:16.512958 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9bde0f-d116-4faf-a0be-b3e3bbddce5f None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:16.548049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a3e23-6e67-42af-9e71-899afff5f81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:16.549033 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a3e23-6e67-42af-9e71-899afff5f81d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:16.549523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a3e23-6e67-42af-9e71-899afff5f81d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:16.550034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a3e23-6e67-42af-9e71-899afff5f81d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:16.558376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a3e23-6e67-42af-9e71-899afff5f81d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:16.560076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a3e23-6e67-42af-9e71-899afff5f81d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:16.571574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-9c5a3e23-6e67-42af-9e71-899afff5f81d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:19:16.571574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:16.571574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:16.571574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:16.571574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:16.571574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:16.571574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:16.571574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:16.571574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:16.571574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:16.571574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:16.571574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:16.571574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:19:16.571574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:19:16.571574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:19:16.571574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:19:16.572530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:16.572530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:16.572530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:19:16.572530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:16.572530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:19:16.572530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:16.572530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:16.572530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:16.572530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:16.572530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:16.572530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:16.572530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:16.572530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:16.572530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:16.572530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:16.572530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:16.572530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:16.572530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:16.573495 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:16.573495 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:16.573495 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:19:16.573495 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:19:16.573495 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:19:16.573495 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:19:16.573495 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:19:16.573495 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:19:16.573495 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:19:16.573495 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:16.580231 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 446/888] 10.222.0.25 () {56 vars in 1117 bytes} [Sat Sep 24 19:19:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:16.582114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ed9ad-47e2-428b-96a6-a471a7ecbfc6 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:16.648140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:16.689788 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ed9ad-47e2-428b-96a6-a471a7ecbfc6 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:16.725439 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47805bf0-5365-4a18-ac6d-45543a66d32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:16.726422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47805bf0-5365-4a18-ac6d-45543a66d32c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:16.726961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47805bf0-5365-4a18-ac6d-45543a66d32c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:16.727986 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47805bf0-5365-4a18-ac6d-45543a66d32c None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:16.728902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47805bf0-5365-4a18-ac6d-45543a66d32c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:16.729425 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47805bf0-5365-4a18-ac6d-45543a66d32c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:16.731076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47805bf0-5365-4a18-ac6d-45543a66d32c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:16.753751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 443/889] 10.222.0.25 () {56 vars in 1149 bytes} [Sat Sep 24 19:19:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:16.755379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a3e23-6e67-42af-9e71-899afff5f81d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:16.818023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:16.861986 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a3e23-6e67-42af-9e71-899afff5f81d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:16.896700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c20ea3-341c-4c9a-a66f-49c5910663d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:16.897355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c20ea3-341c-4c9a-a66f-49c5910663d5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:16.897631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c20ea3-341c-4c9a-a66f-49c5910663d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:16.897948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c20ea3-341c-4c9a-a66f-49c5910663d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:16.973555 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c20ea3-341c-4c9a-a66f-49c5910663d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:16.974954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c20ea3-341c-4c9a-a66f-49c5910663d5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:17.043187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:17.076997 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8910773-0a43-4b0e-87e9-5c3f167086ac None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:17.077651 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8910773-0a43-4b0e-87e9-5c3f167086ac None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:17.078146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8910773-0a43-4b0e-87e9-5c3f167086ac None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:17.080023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 444/890] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:19:17.086361 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e864a-e2b2-4666-8762-01b9d3dcddcc None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:17.087670 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e864a-e2b2-4666-8762-01b9d3dcddcc None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:17.088296 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e864a-e2b2-4666-8762-01b9d3dcddcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:17.098346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 447/891] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:19:16 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:19:17.100236 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c20ea3-341c-4c9a-a66f-49c5910663d5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:17.113326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-c95e864a-e2b2-4666-8762-01b9d3dcddcc None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:17.114911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c95e864a-e2b2-4666-8762-01b9d3dcddcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:17.218888 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 445/892] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:17.251545 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c20ea3-341c-4c9a-a66f-49c5910663d5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:17.291105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206239ff-550e-428b-9b6b-bdd289afb9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:17.291737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206239ff-550e-428b-9b6b-bdd289afb9d8 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:17.292010 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206239ff-550e-428b-9b6b-bdd289afb9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:17.292279 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206239ff-550e-428b-9b6b-bdd289afb9d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:17.303366 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206239ff-550e-428b-9b6b-bdd289afb9d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:17.304861 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206239ff-550e-428b-9b6b-bdd289afb9d8 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:17.321517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-206239ff-550e-428b-9b6b-bdd289afb9d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:17.321517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:17.321517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:17.321517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:17.321517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:17.321517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:17.321517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:17.321517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:17.321517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:17.321517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:17.321517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:17.321517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:17.321517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:17.321517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:17.321517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:17.321517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:17.322679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:17.322679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:17.322679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:17.322679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:17.322679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:17.322679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:17.322679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:17.322679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:17.322679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:17.322679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:17.322679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:17.322679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:17.322679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:17.322679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:17.322679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:17.322679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:17.322679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:17.324216 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:17.324216 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:17.324216 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:17.324216 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 448/893] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:17.326234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75f697-85cc-4739-9247-30649e7fe799 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:17.326691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75f697-85cc-4739-9247-30649e7fe799 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:17.326784 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75f697-85cc-4739-9247-30649e7fe799 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:17.328644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206239ff-550e-428b-9b6b-bdd289afb9d8 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:17.329136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 446/894] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:17.335427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a6068-0f57-4cb3-8aa9-9a5dbd6290dd None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:17.335798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a6068-0f57-4cb3-8aa9-9a5dbd6290dd None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:17.336154 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a6068-0f57-4cb3-8aa9-9a5dbd6290dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:17.354262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:17.373411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-2d5a6068-0f57-4cb3-8aa9-9a5dbd6290dd None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:17.375244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2d5a6068-0f57-4cb3-8aa9-9a5dbd6290dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:17.444408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:17.473806 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206239ff-550e-428b-9b6b-bdd289afb9d8 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:17.474604 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 447/895] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:19:17.516045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619fed9-8cf7-4e1b-a723-8172e4cee31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:17.516776 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619fed9-8cf7-4e1b-a723-8172e4cee31d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:17.517187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619fed9-8cf7-4e1b-a723-8172e4cee31d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:17.517531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619fed9-8cf7-4e1b-a723-8172e4cee31d None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:17.518269 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619fed9-8cf7-4e1b-a723-8172e4cee31d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:17.518643 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619fed9-8cf7-4e1b-a723-8172e4cee31d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:17.520362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619fed9-8cf7-4e1b-a723-8172e4cee31d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:17.521960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a6068-0f57-4cb3-8aa9-9a5dbd6290dd None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:17.536240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 449/896] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:17.542282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619fed9-8cf7-4e1b-a723-8172e4cee31d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:17.624971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:17.657481 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a6068-0f57-4cb3-8aa9-9a5dbd6290dd None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:17.660697 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619fed9-8cf7-4e1b-a723-8172e4cee31d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:17.692418 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22a763-eeef-4fd7-8b72-39cdf917fff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:17.693357 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22a763-eeef-4fd7-8b72-39cdf917fff2 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:17.693813 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22a763-eeef-4fd7-8b72-39cdf917fff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:17.694255 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22a763-eeef-4fd7-8b72-39cdf917fff2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:17.695044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22a763-eeef-4fd7-8b72-39cdf917fff2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:17.697418 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22a763-eeef-4fd7-8b72-39cdf917fff2 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:17.697939 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffcd3e-c006-44b4-ad3f-8c76d880e096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:17.698559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffcd3e-c006-44b4-ad3f-8c76d880e096 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:17.698859 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffcd3e-c006-44b4-ad3f-8c76d880e096 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:17.699132 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffcd3e-c006-44b4-ad3f-8c76d880e096 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:17.705669 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffcd3e-c006-44b4-ad3f-8c76d880e096 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:17.707114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffcd3e-c006-44b4-ad3f-8c76d880e096 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:17.708213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-4c22a763-eeef-4fd7-8b72-39cdf917fff2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:19:17.708213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:17.708213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:19:17.708213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:19:17.708213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:19:17.708213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:19:17.708213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:19:17.708213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:17.708213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:19:17.708213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:17.708213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:17.708213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:17.708213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:17.708213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:17.708213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:17.708213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:17.708213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:17.709314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:17.709314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:17.709314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:17.709314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:17.709314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:17.709314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:17.709314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:19:17.709314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:19:17.709314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:19:17.709314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:19:17.709314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:17.709314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:17.709314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:17.709314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:17.709314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:17.709314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:17.710173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:17.710173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:17.710173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:17.710173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:17.710173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:17.710173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:17.710173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:17.710173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:17.710173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:17.710173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:17.710173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:19:17.710173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:17.710173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:19:17.710173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:17.716857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 448/897] 10.222.0.25 () {56 vars in 1114 bytes} [Sat Sep 24 19:19:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:17.716857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c5ec0-7c50-43a1-8fc6-9a3434e8d8c0 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:17.716857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c5ec0-7c50-43a1-8fc6-9a3434e8d8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:17.716857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c5ec0-7c50-43a1-8fc6-9a3434e8d8c0 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:17.718906 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 449/898] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:17.719459 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-dfffcd3e-c006-44b4-ad3f-8c76d880e096 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:17.719459 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:17.719459 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:17.719459 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:17.719459 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:17.719459 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:17.719459 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:17.719459 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:17.719459 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:17.719459 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:17.719459 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:17.719459 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:17.719459 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:19:17.719459 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:19:17.719459 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:19:17.720656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:19:17.720656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:17.720656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:17.720656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:17.720656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:17.720656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:17.720656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:17.720656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:17.720656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:17.720656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:17.720656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:17.720656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:17.720656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:17.720656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:17.720656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:17.720656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:17.720656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:17.722702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:19:17.722702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:19:17.722702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:19:17.722702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:19:17.722702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:19:17.722702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:19:17.722702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:17.722702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:17.723746 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c5ec0-7c50-43a1-8fc6-9a3434e8d8c0 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:17.725281 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 450/899] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:19:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:17.726426 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79dc5e-2161-46ae-abce-0d089b8f02e4 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:17.726711 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79dc5e-2161-46ae-abce-0d089b8f02e4 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:17.727044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79dc5e-2161-46ae-abce-0d089b8f02e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:17.745216 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-3c79dc5e-2161-46ae-abce-0d089b8f02e4 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:17.746399 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-3c79dc5e-2161-46ae-abce-0d089b8f02e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:17.768762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:17.813594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 451/900] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:17.814505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79dc5e-2161-46ae-abce-0d089b8f02e4 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:17.829353 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c5ec0-7c50-43a1-8fc6-9a3434e8d8c0 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:17.871405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d749eb1-185c-49eb-a3ee-1e4f599eab2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:17.872428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d749eb1-185c-49eb-a3ee-1e4f599eab2e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:17.872768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d749eb1-185c-49eb-a3ee-1e4f599eab2e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:17.873256 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d749eb1-185c-49eb-a3ee-1e4f599eab2e None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:17.873884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d749eb1-185c-49eb-a3ee-1e4f599eab2e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:17.874448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d749eb1-185c-49eb-a3ee-1e4f599eab2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:17.875416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:17.877642 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d749eb1-185c-49eb-a3ee-1e4f599eab2e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:17.889778 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 450/901] 10.222.0.25 () {56 vars in 1114 bytes} [Sat Sep 24 19:19:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:17.889778 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d749eb1-185c-49eb-a3ee-1e4f599eab2e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:17.920265 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79dc5e-2161-46ae-abce-0d089b8f02e4 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:17.958561 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce4396-b85f-4140-82cf-261aae966162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:17.959190 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce4396-b85f-4140-82cf-261aae966162 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:17.959464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce4396-b85f-4140-82cf-261aae966162 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:17.959739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce4396-b85f-4140-82cf-261aae966162 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:17.960405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce4396-b85f-4140-82cf-261aae966162 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:17.960701 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce4396-b85f-4140-82cf-261aae966162 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:17.963200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce4396-b85f-4140-82cf-261aae966162 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:17.984347 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 452/902] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:19:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:17.984347 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce4396-b85f-4140-82cf-261aae966162 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:18.003055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d749eb1-185c-49eb-a3ee-1e4f599eab2e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:18.012693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:18.041658 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618f32e-1ad8-4c36-812d-f319ef64b30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:18.042520 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618f32e-1ad8-4c36-812d-f319ef64b30a None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:18.042796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618f32e-1ad8-4c36-812d-f319ef64b30a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:18.043096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618f32e-1ad8-4c36-812d-f319ef64b30a None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:18.043744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618f32e-1ad8-4c36-812d-f319ef64b30a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:18.045159 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618f32e-1ad8-4c36-812d-f319ef64b30a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:18.069956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 451/903] 10.222.0.25 () {60 vars in 1141 bytes} [Sat Sep 24 19:19:17 2022] POST /identity/v3/services => generated 241 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:19:18.074893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618f32e-1ad8-4c36-812d-f319ef64b30a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:18.106227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce4396-b85f-4140-82cf-261aae966162 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:18.132814 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:18.158528 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996754eb-3ee5-4eac-95fc-a3c4922941af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:18.159504 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996754eb-3ee5-4eac-95fc-a3c4922941af None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:18.159850 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996754eb-3ee5-4eac-95fc-a3c4922941af None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:18.160173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996754eb-3ee5-4eac-95fc-a3c4922941af None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:18.160875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996754eb-3ee5-4eac-95fc-a3c4922941af None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:18.161233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996754eb-3ee5-4eac-95fc-a3c4922941af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:18.162688 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996754eb-3ee5-4eac-95fc-a3c4922941af None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:18.169014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 453/904] 10.222.0.25 () {56 vars in 1114 bytes} [Sat Sep 24 19:19:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:18.169014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996754eb-3ee5-4eac-95fc-a3c4922941af None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:18.204288 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618f32e-1ad8-4c36-812d-f319ef64b30a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:18.247206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b685e-3f61-4cab-985b-a20271356e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:18.247823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b685e-3f61-4cab-985b-a20271356e97 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:18.248106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b685e-3f61-4cab-985b-a20271356e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:18.248837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b685e-3f61-4cab-985b-a20271356e97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:18.249103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b685e-3f61-4cab-985b-a20271356e97 None admin] RBAC: Adding query filter params (role.id=c350cad9e8c64a188a5f0b2bafe29a40, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=7c398cf6318240f09d2c3b62bc6761d5) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:18.249410 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b685e-3f61-4cab-985b-a20271356e97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:18.250942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b685e-3f61-4cab-985b-a20271356e97 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:18.256656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 452/905] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:19:18 2022] GET /identity/v3/role_assignments?user.id=7c398cf6318240f09d2c3b62bc6761d5&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=c350cad9e8c64a188a5f0b2bafe29a40 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:18.257422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b685e-3f61-4cab-985b-a20271356e97 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:18.297250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:18.300738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996754eb-3ee5-4eac-95fc-a3c4922941af None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:18.352279 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48485fbb-5b63-47ec-96ad-2646337178da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:18.353307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48485fbb-5b63-47ec-96ad-2646337178da None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:18.353748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48485fbb-5b63-47ec-96ad-2646337178da None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:18.354317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48485fbb-5b63-47ec-96ad-2646337178da None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:18.356614 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48485fbb-5b63-47ec-96ad-2646337178da None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:18.357766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48485fbb-5b63-47ec-96ad-2646337178da None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:18.377072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-48485fbb-5b63-47ec-96ad-2646337178da None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:19:18.377072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:18.377072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:19:18.377072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:19:18.377072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:19:18.377072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:19:18.377072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:19:18.377072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:18.377072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:19:18.377072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:18.377072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:18.377072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:18.377072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:18.377072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:18.377072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:18.377072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:18.378109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:18.378109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:18.378109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:18.378109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:18.378109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:18.378109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:18.378109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:18.378109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:19:18.378109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:19:18.378109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:19:18.378109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:19:18.378109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:18.378109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:18.378109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:18.378109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:18.378109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:18.378109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:18.384967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:18.384967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:18.384967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:18.384967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:18.384967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:18.384967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:18.384967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:18.384967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:18.384967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:18.384967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:18.384967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:19:18.384967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:18.384967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:19:18.384967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:18.384967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 454/906] 10.222.0.25 () {56 vars in 1132 bytes} [Sat Sep 24 19:19:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:18.385784 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48485fbb-5b63-47ec-96ad-2646337178da None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:18.396031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b685e-3f61-4cab-985b-a20271356e97 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:18.438810 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428b07f-d3b3-435c-a7e5-91576e46a608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:18.439884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428b07f-d3b3-435c-a7e5-91576e46a608 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:18.440383 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428b07f-d3b3-435c-a7e5-91576e46a608 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:18.440870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428b07f-d3b3-435c-a7e5-91576e46a608 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:18.441780 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428b07f-d3b3-435c-a7e5-91576e46a608 None admin] RBAC: Adding query filter params (interface=public, service_id=3c597f862c574a798ac24d316f8a0353, region_id=RegionOne) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:18.442364 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428b07f-d3b3-435c-a7e5-91576e46a608 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:18.444066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428b07f-d3b3-435c-a7e5-91576e46a608 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:18.448311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:18.455451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 453/907] 10.222.0.25 () {56 vars in 1251 bytes} [Sat Sep 24 19:19:18 2022] GET /identity/v3/endpoints?service_id=3c597f862c574a798ac24d316f8a0353&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:18.462067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428b07f-d3b3-435c-a7e5-91576e46a608 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:18.523673 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48485fbb-5b63-47ec-96ad-2646337178da None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:18.567261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:18.572069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733d31b-a50b-486a-92bb-0ff3809eff76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:18.572960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733d31b-a50b-486a-92bb-0ff3809eff76 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:18.573484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733d31b-a50b-486a-92bb-0ff3809eff76 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:18.573785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428b07f-d3b3-435c-a7e5-91576e46a608 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:18.574185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733d31b-a50b-486a-92bb-0ff3809eff76 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:18.575077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733d31b-a50b-486a-92bb-0ff3809eff76 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:18.575633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733d31b-a50b-486a-92bb-0ff3809eff76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:18.577432 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733d31b-a50b-486a-92bb-0ff3809eff76 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:18.588314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 455/908] 10.222.0.25 () {56 vars in 1126 bytes} [Sat Sep 24 19:19:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:18.589588 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733d31b-a50b-486a-92bb-0ff3809eff76 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:18.623000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98939f-bbb7-47aa-aeae-8a175d389535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:18.623624 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98939f-bbb7-47aa-aeae-8a175d389535 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:18.623900 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98939f-bbb7-47aa-aeae-8a175d389535 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:18.624401 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98939f-bbb7-47aa-aeae-8a175d389535 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:18.625035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98939f-bbb7-47aa-aeae-8a175d389535 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:18.627268 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98939f-bbb7-47aa-aeae-8a175d389535 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:18.638922 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 454/909] 10.222.0.25 () {56 vars in 1087 bytes} [Sat Sep 24 19:19:18 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:19:18.712132 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733d31b-a50b-486a-92bb-0ff3809eff76 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:18.723614 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:18.752400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa91f7f-0ba2-43be-adee-ef3a873f34eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:18.753422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa91f7f-0ba2-43be-adee-ef3a873f34eb None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:18.753902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa91f7f-0ba2-43be-adee-ef3a873f34eb None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:18.754404 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa91f7f-0ba2-43be-adee-ef3a873f34eb None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:18.755287 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa91f7f-0ba2-43be-adee-ef3a873f34eb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:18.755795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa91f7f-0ba2-43be-adee-ef3a873f34eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:18.757470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa91f7f-0ba2-43be-adee-ef3a873f34eb None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:18.764209 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 456/910] 10.222.0.25 () {56 vars in 1126 bytes} [Sat Sep 24 19:19:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:18.770607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98939f-bbb7-47aa-aeae-8a175d389535 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:18.884072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98939f-bbb7-47aa-aeae-8a175d389535 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:18.923599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4140f-c1bf-4655-9761-76f7ae6d8775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:18.924263 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4140f-c1bf-4655-9761-76f7ae6d8775 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:18.924548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4140f-c1bf-4655-9761-76f7ae6d8775 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:18.924822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4140f-c1bf-4655-9761-76f7ae6d8775 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:18.925528 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4140f-c1bf-4655-9761-76f7ae6d8775 None admin] RBAC: Adding query filter params (interface=public, service_id=ba046e3430e54320b45724280b3367a4, region_id=RegionOne) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:18.925836 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4140f-c1bf-4655-9761-76f7ae6d8775 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:18.927325 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4140f-c1bf-4655-9761-76f7ae6d8775 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:18.933457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 455/911] 10.222.0.25 () {56 vars in 1251 bytes} [Sat Sep 24 19:19:18 2022] GET /identity/v3/endpoints?service_id=ba046e3430e54320b45724280b3367a4&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:18.939023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa91f7f-0ba2-43be-adee-ef3a873f34eb None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:19.057025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa91f7f-0ba2-43be-adee-ef3a873f34eb None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:19.093503 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361507d-139f-4e22-a28d-942c4e9e7f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:19.094116 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361507d-139f-4e22-a28d-942c4e9e7f33 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:19.094397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361507d-139f-4e22-a28d-942c4e9e7f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:19.094668 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361507d-139f-4e22-a28d-942c4e9e7f33 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:19.095294 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361507d-139f-4e22-a28d-942c4e9e7f33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:19.096661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361507d-139f-4e22-a28d-942c4e9e7f33 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:19.103940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 457/912] 10.222.0.25 () {56 vars in 1087 bytes} [Sat Sep 24 19:19:18 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:19:20.307028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487beddf-4cf8-41b3-8245-33d5907f1a72 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:20.307586 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487beddf-4cf8-41b3-8245-33d5907f1a72 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:20.307586 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487beddf-4cf8-41b3-8245-33d5907f1a72 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:20.309143 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 456/913] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:20.314558 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b28b5-8a6c-4ead-bd40-e2aea59c00f2 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:20.314986 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b28b5-8a6c-4ead-bd40-e2aea59c00f2 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:20.315151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b28b5-8a6c-4ead-bd40-e2aea59c00f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:20.333451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-3c5b28b5-8a6c-4ead-bd40-e2aea59c00f2 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:20.334640 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-3c5b28b5-8a6c-4ead-bd40-e2aea59c00f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:20.365956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:20.410088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 458/914] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:20.567935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd64bc-ea4b-4c2c-8612-20f6a28b60d9 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:20.568546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd64bc-ea4b-4c2c-8612-20f6a28b60d9 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:20.569042 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd64bc-ea4b-4c2c-8612-20f6a28b60d9 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:20.570820 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 457/915] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:20.576250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d699364-697b-448e-a802-1fe4baf67454 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:20.576599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d699364-697b-448e-a802-1fe4baf67454 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:20.576878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d699364-697b-448e-a802-1fe4baf67454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:20.595504 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-1d699364-697b-448e-a802-1fe4baf67454 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:20.596687 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1d699364-697b-448e-a802-1fe4baf67454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:20.667823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 459/916] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:20.688404 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd64bc-ea4b-4c2c-8612-20f6a28b60d9 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:20.716529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:20.799271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd64bc-ea4b-4c2c-8612-20f6a28b60d9 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:20.835885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c13f6-d292-4dfb-8015-4bbd075749a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:20.837095 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c13f6-d292-4dfb-8015-4bbd075749a5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:20.837467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c13f6-d292-4dfb-8015-4bbd075749a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:20.837844 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c13f6-d292-4dfb-8015-4bbd075749a5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:20.838428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c13f6-d292-4dfb-8015-4bbd075749a5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:20.839891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c13f6-d292-4dfb-8015-4bbd075749a5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:20.849295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-b17c13f6-d292-4dfb-8015-4bbd075749a5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:19:20.849295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:20.849295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:19:20.849295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:19:20.849295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:19:20.849295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:19:20.849295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:19:20.849295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:20.849295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:19:20.849295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:20.849295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:20.849295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:20.849295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:20.849295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:20.849295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:20.849295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:20.849295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:20.850301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:20.850301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:20.850301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:20.850301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:20.850301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:20.850301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:20.850301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:19:20.850301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:19:20.850301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:19:20.850301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:19:20.850301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:20.850301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:20.850301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:20.850301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:20.850301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:20.850301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:20.851200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:20.851200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:20.851200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:20.851200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:20.851200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:20.851200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:20.851200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:20.851200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:20.851200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:20.851200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:20.851200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:19:20.851200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:20.851200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:19:20.851200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:20.854975 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 458/917] 10.222.0.25 () {56 vars in 1126 bytes} [Sat Sep 24 19:19:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:20.856980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d699364-697b-448e-a802-1fe4baf67454 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:20.967579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d699364-697b-448e-a802-1fe4baf67454 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:20.971256 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:20.976196 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c13f6-d292-4dfb-8015-4bbd075749a5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:21.009213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81317c67-c8d2-4c5d-8eea-5d21b65cafe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:21.009814 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81317c67-c8d2-4c5d-8eea-5d21b65cafe0 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:21.010096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81317c67-c8d2-4c5d-8eea-5d21b65cafe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:21.010369 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81317c67-c8d2-4c5d-8eea-5d21b65cafe0 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:21.011031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81317c67-c8d2-4c5d-8eea-5d21b65cafe0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:21.011336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81317c67-c8d2-4c5d-8eea-5d21b65cafe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:21.012701 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81317c67-c8d2-4c5d-8eea-5d21b65cafe0 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:21.018643 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 460/918] 10.222.0.25 () {56 vars in 1122 bytes} [Sat Sep 24 19:19:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:21.022387 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a1850-1b6f-4842-b88b-eb23db0964ba None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:21.022387 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a1850-1b6f-4842-b88b-eb23db0964ba None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:21.022387 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a1850-1b6f-4842-b88b-eb23db0964ba None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:21.022657 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 461/919] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:21.030212 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabe3e0-2c7b-4573-aeeb-6541e77fe0bf None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:21.030747 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabe3e0-2c7b-4573-aeeb-6541e77fe0bf None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:21.031054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabe3e0-2c7b-4573-aeeb-6541e77fe0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:21.054585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-fcabe3e0-2c7b-4573-aeeb-6541e77fe0bf None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:21.055987 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-fcabe3e0-2c7b-4573-aeeb-6541e77fe0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:21.075907 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:21.089794 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c13f6-d292-4dfb-8015-4bbd075749a5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:21.127749 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aaf912-6793-4d38-88a4-9aaaaca6bc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:21.128384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aaf912-6793-4d38-88a4-9aaaaca6bc54 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:21.128935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aaf912-6793-4d38-88a4-9aaaaca6bc54 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:21.129063 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 462/920] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:21.129146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aaf912-6793-4d38-88a4-9aaaaca6bc54 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:21.136077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabe3e0-2c7b-4573-aeeb-6541e77fe0bf None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:21.141536 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aaf912-6793-4d38-88a4-9aaaaca6bc54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:19:21.146422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-15aaf912-6793-4d38-88a4-9aaaaca6bc54 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:19:21.146422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:21.146422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:21.146422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:21.146422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:21.146422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:21.146422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:21.146422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:21.146422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:21.146422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:21.146422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:21.146422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:21.146422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:19:21.146422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:19:21.146422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:19:21.146422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:19:21.147423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:19:21.147423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:19:21.147423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:19:21.147423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:19:21.147423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:21.147423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:21.147423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:21.147423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:21.147423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:21.147423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:21.147423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:21.147423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:21.147423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:21.147423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:21.147423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:21.147423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:21.148652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:21.148652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:21.148652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:21.148652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:21.148652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:19:21.148652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:19:21.148652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:19:21.148652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:19:21.148652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:19:21.148652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:19:21.148652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:19:21.148652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:21.148652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 459/921] 10.222.0.25 () {56 vars in 1120 bytes} [Sat Sep 24 19:19:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:21.154076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aaf912-6793-4d38-88a4-9aaaaca6bc54 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:21.264744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aaf912-6793-4d38-88a4-9aaaaca6bc54 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:21.266801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:21.280995 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabe3e0-2c7b-4573-aeeb-6541e77fe0bf None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:21.309008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9500fb5-a058-4453-bd3a-e049cdc322e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:21.309586 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9500fb5-a058-4453-bd3a-e049cdc322e6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:21.309761 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9500fb5-a058-4453-bd3a-e049cdc322e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:21.310122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9500fb5-a058-4453-bd3a-e049cdc322e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:21.310903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9500fb5-a058-4453-bd3a-e049cdc322e6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:21.311276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9500fb5-a058-4453-bd3a-e049cdc322e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:21.312785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9500fb5-a058-4453-bd3a-e049cdc322e6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:21.326894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db2694-aa27-4cff-9f57-d1bc4920c6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:21.327650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 460/922] 10.222.0.25 () {56 vars in 1115 bytes} [Sat Sep 24 19:19:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:21.328620 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db2694-aa27-4cff-9f57-d1bc4920c6c7 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:21.328757 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9500fb5-a058-4453-bd3a-e049cdc322e6 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:21.328949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db2694-aa27-4cff-9f57-d1bc4920c6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:21.329268 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db2694-aa27-4cff-9f57-d1bc4920c6c7 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:21.329899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db2694-aa27-4cff-9f57-d1bc4920c6c7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:21.330198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db2694-aa27-4cff-9f57-d1bc4920c6c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:21.331877 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db2694-aa27-4cff-9f57-d1bc4920c6c7 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:21.339182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 463/923] 10.222.0.25 () {56 vars in 1122 bytes} [Sat Sep 24 19:19:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:21.342943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eec32b-0996-4627-9289-c9d4f1ce903b None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:21.342943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eec32b-0996-4627-9289-c9d4f1ce903b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:21.342943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eec32b-0996-4627-9289-c9d4f1ce903b None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:21.343390 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 464/924] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:21.343701 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:21.345325 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eec32b-0996-4627-9289-c9d4f1ce903b None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:21.438255 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9500fb5-a058-4453-bd3a-e049cdc322e6 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:21.456358 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eec32b-0996-4627-9289-c9d4f1ce903b None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:21.476647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b994ac-ec62-47d6-b1f5-2b68d00a9181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:21.477362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b994ac-ec62-47d6-b1f5-2b68d00a9181 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:21.477628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b994ac-ec62-47d6-b1f5-2b68d00a9181 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:21.477889 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b994ac-ec62-47d6-b1f5-2b68d00a9181 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:21.488099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b994ac-ec62-47d6-b1f5-2b68d00a9181 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:21.489511 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b994ac-ec62-47d6-b1f5-2b68d00a9181 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:21.489927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e95c0-7d86-4bd9-bf7f-7eef492558b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:21.490520 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e95c0-7d86-4bd9-bf7f-7eef492558b3 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:21.490840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e95c0-7d86-4bd9-bf7f-7eef492558b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:21.491284 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e95c0-7d86-4bd9-bf7f-7eef492558b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:21.492310 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e95c0-7d86-4bd9-bf7f-7eef492558b3 None admin] RBAC: Adding query filter params (interface=public, service_id=cc40d02369c445f2851ea6149dda4f79, region_id=RegionOne) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:21.493253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e95c0-7d86-4bd9-bf7f-7eef492558b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:21.494627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e95c0-7d86-4bd9-bf7f-7eef492558b3 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:21.500560 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 465/925] 10.222.0.25 () {56 vars in 1251 bytes} [Sat Sep 24 19:19:21 2022] GET /identity/v3/endpoints?service_id=cc40d02369c445f2851ea6149dda4f79&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:21.501478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb5b07-9908-487f-9a75-f0134979e7fa None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:21.501756 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb5b07-9908-487f-9a75-f0134979e7fa None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:21.502026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb5b07-9908-487f-9a75-f0134979e7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:21.504115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-e1b994ac-ec62-47d6-b1f5-2b68d00a9181 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:21.504115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:21.504115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:21.504115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:21.504115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:21.504115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:21.504115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:21.504115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:21.504115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:21.504115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:21.504115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:21.504115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:21.504115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:21.504115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:21.504115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:21.504115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:21.505547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:21.505547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:21.505547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:21.505547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:21.505547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:21.505547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:21.505547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:21.505547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:21.505547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:21.505547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:21.505547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:21.505547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:21.505547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:21.505547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:21.505547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:21.505547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:21.505547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:21.506531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:21.506531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:21.506531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:21.506531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 461/926] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:21.506531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b994ac-ec62-47d6-b1f5-2b68d00a9181 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:21.521990 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-d2eb5b07-9908-487f-9a75-f0134979e7fa None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:21.523221 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d2eb5b07-9908-487f-9a75-f0134979e7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:21.536173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:21.568290 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:21.592536 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 466/927] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:21.593415 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb5b07-9908-487f-9a75-f0134979e7fa None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:21.629479 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b994ac-ec62-47d6-b1f5-2b68d00a9181 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:21.675061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c4dfb-ff1d-4f71-99f0-20fad87c7ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:21.675842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c4dfb-ff1d-4f71-99f0-20fad87c7ccc None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:21.676121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c4dfb-ff1d-4f71-99f0-20fad87c7ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:21.676762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c4dfb-ff1d-4f71-99f0-20fad87c7ccc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:21.677601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c4dfb-ff1d-4f71-99f0-20fad87c7ccc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:21.679157 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c4dfb-ff1d-4f71-99f0-20fad87c7ccc None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:21.688953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-be7c4dfb-ff1d-4f71-99f0-20fad87c7ccc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:19:21.688953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:21.688953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:19:21.688953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:19:21.688953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:19:21.688953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:19:21.688953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:19:21.688953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:21.688953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:19:21.688953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:21.688953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:21.688953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:21.688953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:21.688953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:21.688953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:21.688953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:21.688953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:21.689947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:21.689947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:21.689947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:21.689947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:21.689947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:21.689947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:21.689947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:19:21.689947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:19:21.689947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:19:21.689947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:19:21.689947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:21.689947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:21.689947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:21.689947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:21.689947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:21.689947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:21.690796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:21.690796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:21.690796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:21.690796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:21.690796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:21.690796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:21.690796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:21.690796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:21.690796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:21.690796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:21.690796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:19:21.690796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:21.690796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:19:21.690796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:21.690796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 462/928] 10.222.0.25 () {56 vars in 1114 bytes} [Sat Sep 24 19:19:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:21.691634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c4dfb-ff1d-4f71-99f0-20fad87c7ccc None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:21.699968 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb5b07-9908-487f-9a75-f0134979e7fa None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:21.738258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d311e-25b6-4834-a588-4782fe38dfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:21.739073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d311e-25b6-4834-a588-4782fe38dfc9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:21.739375 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d311e-25b6-4834-a588-4782fe38dfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:21.739645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d311e-25b6-4834-a588-4782fe38dfc9 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:21.740233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d311e-25b6-4834-a588-4782fe38dfc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:21.741584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d311e-25b6-4834-a588-4782fe38dfc9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:21.758859 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 467/929] 10.222.0.25 () {56 vars in 1087 bytes} [Sat Sep 24 19:19:21 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:19:21.758859 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d311e-25b6-4834-a588-4782fe38dfc9 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:21.780410 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:21.830650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c4dfb-ff1d-4f71-99f0-20fad87c7ccc None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:21.870419 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:21.881225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ac68b-f2fe-4d0b-8a68-0fb7a5fe45fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:21.881852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ac68b-f2fe-4d0b-8a68-0fb7a5fe45fc None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:21.882127 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ac68b-f2fe-4d0b-8a68-0fb7a5fe45fc None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:21.882394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ac68b-f2fe-4d0b-8a68-0fb7a5fe45fc None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:21.883809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ac68b-f2fe-4d0b-8a68-0fb7a5fe45fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:21.884478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ac68b-f2fe-4d0b-8a68-0fb7a5fe45fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:21.886036 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ac68b-f2fe-4d0b-8a68-0fb7a5fe45fc None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:21.887111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d311e-25b6-4834-a588-4782fe38dfc9 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:21.904961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 463/930] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:21.904961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ac68b-f2fe-4d0b-8a68-0fb7a5fe45fc None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:21.935638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6dfe3-0ca1-40c3-9f65-0266d07271f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:21.936275 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6dfe3-0ca1-40c3-9f65-0266d07271f5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:21.936548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6dfe3-0ca1-40c3-9f65-0266d07271f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:21.936818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6dfe3-0ca1-40c3-9f65-0266d07271f5 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:21.937442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6dfe3-0ca1-40c3-9f65-0266d07271f5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:21.937766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6dfe3-0ca1-40c3-9f65-0266d07271f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:21.939139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6dfe3-0ca1-40c3-9f65-0266d07271f5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:21.944795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 468/931] 10.222.0.25 () {56 vars in 1114 bytes} [Sat Sep 24 19:19:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:21.945714 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6dfe3-0ca1-40c3-9f65-0266d07271f5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:22.013214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ac68b-f2fe-4d0b-8a68-0fb7a5fe45fc None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:22.031860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:22.054182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1df7b1-a4a7-423e-b60d-5a9251a94bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:22.054818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1df7b1-a4a7-423e-b60d-5a9251a94bdc None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:22.055256 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1df7b1-a4a7-423e-b60d-5a9251a94bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:22.055509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1df7b1-a4a7-423e-b60d-5a9251a94bdc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:22.055901 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6dfe3-0ca1-40c3-9f65-0266d07271f5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:22.056078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1df7b1-a4a7-423e-b60d-5a9251a94bdc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:22.057432 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1df7b1-a4a7-423e-b60d-5a9251a94bdc None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:22.066752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-2d1df7b1-a4a7-423e-b60d-5a9251a94bdc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:19:22.066752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:22.066752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:19:22.066752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:19:22.066752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:19:22.066752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:19:22.066752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:19:22.066752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:22.066752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:19:22.066752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:22.066752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:22.066752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:22.066752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:22.066752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:22.066752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:22.066752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:22.067766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:22.067766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:22.067766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:22.067766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:22.067766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:22.067766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:22.067766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:22.067766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:19:22.067766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:19:22.067766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:19:22.067766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:19:22.067766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:22.067766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:22.067766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:22.067766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:22.067766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:22.067766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:22.068659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:22.068659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:22.068659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:22.068659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:22.068659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:22.068659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:22.068659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:22.068659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:22.068659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:22.068659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:22.068659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:19:22.068659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:22.068659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:19:22.068659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:22.068659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 464/932] 10.222.0.25 () {56 vars in 1132 bytes} [Sat Sep 24 19:19:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:22.069477 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1df7b1-a4a7-423e-b60d-5a9251a94bdc None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:22.098386 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be60ff-b085-4a18-af2f-68d00de9a4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:22.099064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be60ff-b085-4a18-af2f-68d00de9a4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:22.099344 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be60ff-b085-4a18-af2f-68d00de9a4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:22.099616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be60ff-b085-4a18-af2f-68d00de9a4b9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:22.108584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be60ff-b085-4a18-af2f-68d00de9a4b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:22.110018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be60ff-b085-4a18-af2f-68d00de9a4b9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:22.122002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-08be60ff-b085-4a18-af2f-68d00de9a4b9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:19:22.122002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:22.122002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:22.122002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:22.122002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:22.122002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:22.122002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:22.122002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:22.122002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:22.122002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:22.122002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:22.122002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:22.122002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:19:22.122002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:19:22.122002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:19:22.122002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:19:22.123086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:22.123086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:22.123086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:19:22.123086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:22.123086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:19:22.123086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:22.123086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:22.123086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:22.123086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:22.123086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:22.123086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:22.123086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:22.123086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:22.123086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:22.123086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:22.123086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:22.123086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:22.123086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:22.124028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:22.124028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:22.124028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:19:22.124028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:19:22.124028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:19:22.124028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:19:22.124028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:19:22.124028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:19:22.124028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:19:22.124028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:22.124028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 469/933] 10.222.0.25 () {56 vars in 1117 bytes} [Sat Sep 24 19:19:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:22.124624 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be60ff-b085-4a18-af2f-68d00de9a4b9 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:22.132072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:22.189208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1df7b1-a4a7-423e-b60d-5a9251a94bdc None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:22.225809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43813216-f3c3-419b-8d33-8dc0fb5c21b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:22.226223 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be60ff-b085-4a18-af2f-68d00de9a4b9 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:22.226652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43813216-f3c3-419b-8d33-8dc0fb5c21b3 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:22.227559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43813216-f3c3-419b-8d33-8dc0fb5c21b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:22.227924 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43813216-f3c3-419b-8d33-8dc0fb5c21b3 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:22.228766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43813216-f3c3-419b-8d33-8dc0fb5c21b3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:22.229264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43813216-f3c3-419b-8d33-8dc0fb5c21b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:22.230681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43813216-f3c3-419b-8d33-8dc0fb5c21b3 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:22.237772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 465/934] 10.222.0.25 () {56 vars in 1114 bytes} [Sat Sep 24 19:19:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:22.237772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43813216-f3c3-419b-8d33-8dc0fb5c21b3 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:22.265480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a48a75-4423-4721-b905-1e5387856983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:22.266078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a48a75-4423-4721-b905-1e5387856983 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:22.266401 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a48a75-4423-4721-b905-1e5387856983 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:22.266610 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a48a75-4423-4721-b905-1e5387856983 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:22.267337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a48a75-4423-4721-b905-1e5387856983 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:22.267546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a48a75-4423-4721-b905-1e5387856983 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:22.268893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a48a75-4423-4721-b905-1e5387856983 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:22.271113 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:22.275771 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 470/935] 10.222.0.25 () {56 vars in 1126 bytes} [Sat Sep 24 19:19:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:22.276474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a48a75-4423-4721-b905-1e5387856983 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:22.354397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43813216-f3c3-419b-8d33-8dc0fb5c21b3 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:22.369710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:22.390871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a48a75-4423-4721-b905-1e5387856983 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:22.394878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18f6fc-7793-4716-8031-5b1a5d5042b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:22.395491 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18f6fc-7793-4716-8031-5b1a5d5042b3 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:22.395800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18f6fc-7793-4716-8031-5b1a5d5042b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:22.396075 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18f6fc-7793-4716-8031-5b1a5d5042b3 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:22.396803 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18f6fc-7793-4716-8031-5b1a5d5042b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:22.397109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18f6fc-7793-4716-8031-5b1a5d5042b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:22.398535 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18f6fc-7793-4716-8031-5b1a5d5042b3 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:22.422208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 466/936] 10.222.0.25 () {56 vars in 1149 bytes} [Sat Sep 24 19:19:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:22.423065 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18f6fc-7793-4716-8031-5b1a5d5042b3 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:22.434442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093759c7-323b-4f45-b040-ce0f00140739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:22.435088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093759c7-323b-4f45-b040-ce0f00140739 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:22.435676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093759c7-323b-4f45-b040-ce0f00140739 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:22.435964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093759c7-323b-4f45-b040-ce0f00140739 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:22.436629 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093759c7-323b-4f45-b040-ce0f00140739 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:22.437987 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093759c7-323b-4f45-b040-ce0f00140739 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:22.470859 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 471/937] 10.222.0.25 () {60 vars in 1144 bytes} [Sat Sep 24 19:19:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:19:22.470859 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093759c7-323b-4f45-b040-ce0f00140739 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:22.538256 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:22.563296 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18f6fc-7793-4716-8031-5b1a5d5042b3 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:22.608790 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cae0af-e764-4d1a-b89d-fb5e7cb9acbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:22.609464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cae0af-e764-4d1a-b89d-fb5e7cb9acbd None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:22.609744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cae0af-e764-4d1a-b89d-fb5e7cb9acbd None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:22.610012 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cae0af-e764-4d1a-b89d-fb5e7cb9acbd None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:22.610689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cae0af-e764-4d1a-b89d-fb5e7cb9acbd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:22.611058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cae0af-e764-4d1a-b89d-fb5e7cb9acbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:22.612641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cae0af-e764-4d1a-b89d-fb5e7cb9acbd None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:22.613361 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093759c7-323b-4f45-b040-ce0f00140739 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:22.619294 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 467/938] 10.222.0.25 () {56 vars in 1126 bytes} [Sat Sep 24 19:19:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:22.627892 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cae0af-e764-4d1a-b89d-fb5e7cb9acbd None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:22.659982 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bb319-f7a9-4abd-a7e6-f0e189ff18bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:22.660556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bb319-f7a9-4abd-a7e6-f0e189ff18bb None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:22.660836 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bb319-f7a9-4abd-a7e6-f0e189ff18bb None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:22.661113 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bb319-f7a9-4abd-a7e6-f0e189ff18bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:22.668649 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:22.679356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bb319-f7a9-4abd-a7e6-f0e189ff18bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:22.681031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bb319-f7a9-4abd-a7e6-f0e189ff18bb None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:22.702650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-0a4bb319-f7a9-4abd-a7e6-f0e189ff18bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:22.702650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:22.702650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:22.702650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:22.702650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:22.702650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:22.702650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:22.702650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:22.702650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:22.702650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:22.702650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:22.702650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:22.702650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:22.702650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:22.702650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:22.702650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:22.703684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:22.703684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:22.703684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:22.703684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:22.703684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:22.703684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:22.703684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:22.703684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:22.703684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:22.703684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:22.703684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:22.703684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:22.703684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:22.703684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:22.703684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:22.703684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:22.703684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:22.704593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:22.704593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:22.704593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:22.704593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 472/939] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:22.709450 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bb319-f7a9-4abd-a7e6-f0e189ff18bb None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:22.762131 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cae0af-e764-4d1a-b89d-fb5e7cb9acbd None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:22.808088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8c39e-ac8d-4a07-b6ad-80d159dad337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:22.808790 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8c39e-ac8d-4a07-b6ad-80d159dad337 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:22.809297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8c39e-ac8d-4a07-b6ad-80d159dad337 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:22.809638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8c39e-ac8d-4a07-b6ad-80d159dad337 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:22.810738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8c39e-ac8d-4a07-b6ad-80d159dad337 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:22.812554 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8c39e-ac8d-4a07-b6ad-80d159dad337 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:22.828321 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bb319-f7a9-4abd-a7e6-f0e189ff18bb None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:22.831490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:22.843205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 468/940] 10.222.0.25 () {60 vars in 1144 bytes} [Sat Sep 24 19:19:22 2022] POST /identity/v3/endpoints => generated 347 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:19:22.881311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99dc09-4bd6-4171-b3c9-ba85cdecba3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:22.881996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99dc09-4bd6-4171-b3c9-ba85cdecba3d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:22.882284 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99dc09-4bd6-4171-b3c9-ba85cdecba3d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:22.882610 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99dc09-4bd6-4171-b3c9-ba85cdecba3d None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:22.883922 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99dc09-4bd6-4171-b3c9-ba85cdecba3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:22.884849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99dc09-4bd6-4171-b3c9-ba85cdecba3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:22.887034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99dc09-4bd6-4171-b3c9-ba85cdecba3d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:22.906501 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 473/941] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:22.908040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8c39e-ac8d-4a07-b6ad-80d159dad337 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:23.018642 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:23.037071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8c39e-ac8d-4a07-b6ad-80d159dad337 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:23.074359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e80da1-392f-4201-b1c6-d81ca6111205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:23.075616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e80da1-392f-4201-b1c6-d81ca6111205 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:23.075616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e80da1-392f-4201-b1c6-d81ca6111205 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:23.075616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e80da1-392f-4201-b1c6-d81ca6111205 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:23.084208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e80da1-392f-4201-b1c6-d81ca6111205 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:23.085713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e80da1-392f-4201-b1c6-d81ca6111205 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:23.098667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-63e80da1-392f-4201-b1c6-d81ca6111205 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:23.098667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:23.098667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:23.098667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:23.098667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:23.098667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:23.098667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:23.098667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:23.098667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:23.098667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:23.098667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:23.098667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:23.098667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:19:23.098667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:19:23.098667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:19:23.099660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:19:23.099660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:23.099660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:23.099660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:23.099660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:23.099660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:23.099660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:23.099660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:23.099660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:23.099660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:23.099660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:23.099660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:23.099660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:23.099660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:23.099660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:23.099660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:23.099660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:23.100593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:19:23.100593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:19:23.100593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:19:23.100593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:19:23.100593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:19:23.100593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:19:23.100593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:23.100593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:23.100593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 469/942] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:19:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:23.106333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99dc09-4bd6-4171-b3c9-ba85cdecba3d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:23.217526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99dc09-4bd6-4171-b3c9-ba85cdecba3d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:23.252124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da915d49-d0eb-4d48-bcf5-af344a78c4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:23.252720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da915d49-d0eb-4d48-bcf5-af344a78c4e9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:23.252993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da915d49-d0eb-4d48-bcf5-af344a78c4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:23.253272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da915d49-d0eb-4d48-bcf5-af344a78c4e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:23.253930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da915d49-d0eb-4d48-bcf5-af344a78c4e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:23.254228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da915d49-d0eb-4d48-bcf5-af344a78c4e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:23.255661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da915d49-d0eb-4d48-bcf5-af344a78c4e9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:23.273416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 474/943] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:19:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:23.275567 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e80da1-392f-4201-b1c6-d81ca6111205 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:23.384328 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e80da1-392f-4201-b1c6-d81ca6111205 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:23.430433 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9879e-9a14-4df8-98f9-7aa435e65cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:23.431794 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9879e-9a14-4df8-98f9-7aa435e65cc4 None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:23.432307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9879e-9a14-4df8-98f9-7aa435e65cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:23.432818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9879e-9a14-4df8-98f9-7aa435e65cc4 None admin] PATH_INFO: `/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/7c398cf6318240f09d2c3b62bc6761d5/roles/c350cad9e8c64a188a5f0b2bafe29a40` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:23.436214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9879e-9a14-4df8-98f9-7aa435e65cc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f61085f09512451e92c9fa36fa9a8071, user_id=7c398cf6318240f09d2c3b62bc6761d5, role_id=c350cad9e8c64a188a5f0b2bafe29a40)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:23.438651 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9879e-9a14-4df8-98f9-7aa435e65cc4 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:23.455275 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 470/944] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:19:23 2022] PUT /identity/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/7c398cf6318240f09d2c3b62bc6761d5/roles/c350cad9e8c64a188a5f0b2bafe29a40 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:19:23.962539 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93152b36-9c37-4034-afa2-5c0288cee5f4 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:23.963137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93152b36-9c37-4034-afa2-5c0288cee5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:23.963137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93152b36-9c37-4034-afa2-5c0288cee5f4 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:23.964696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 475/945] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:23.970258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88812c5-11cf-4851-b563-47238bb2aef0 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:23.970545 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88812c5-11cf-4851-b563-47238bb2aef0 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:23.970819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88812c5-11cf-4851-b563-47238bb2aef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:23.989710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-b88812c5-11cf-4851-b563-47238bb2aef0 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:23.990927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b88812c5-11cf-4851-b563-47238bb2aef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:23.993608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:24.068788 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 471/946] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:19:24.340128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93152b36-9c37-4034-afa2-5c0288cee5f4 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:24.364652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:24.449152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93152b36-9c37-4034-afa2-5c0288cee5f4 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:24.484604 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541190c0-ef46-4e52-a4eb-de46103f0a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:24.485232 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541190c0-ef46-4e52-a4eb-de46103f0a73 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:24.485513 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541190c0-ef46-4e52-a4eb-de46103f0a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:24.485780 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541190c0-ef46-4e52-a4eb-de46103f0a73 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:24.486355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541190c0-ef46-4e52-a4eb-de46103f0a73 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:24.487748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541190c0-ef46-4e52-a4eb-de46103f0a73 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:24.496787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-541190c0-ef46-4e52-a4eb-de46103f0a73 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:19:24.496787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:24.496787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:19:24.496787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:19:24.496787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:19:24.496787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:19:24.496787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:19:24.496787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:24.496787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:19:24.496787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:24.496787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:24.496787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:24.496787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:24.496787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:24.496787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:24.496787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:24.496787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:24.497766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:24.497766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:24.497766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:24.497766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:24.497766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:24.497766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:24.497766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:19:24.497766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:19:24.497766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:19:24.497766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:19:24.497766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:24.497766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:24.497766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:24.497766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:24.497766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:24.497766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:24.498659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:24.498659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:24.498659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:24.498659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:24.498659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:24.498659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:24.498659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:24.498659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:24.498659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:24.498659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:24.498659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:19:24.498659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:24.498659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:19:24.498659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:24.502858 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 476/947] 10.222.0.25 () {56 vars in 1126 bytes} [Sat Sep 24 19:19:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:24.507951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88812c5-11cf-4851-b563-47238bb2aef0 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:24.611777 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88812c5-11cf-4851-b563-47238bb2aef0 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:24.647396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189be38-0aa8-4270-b8cc-659f53d5359c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:24.648006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189be38-0aa8-4270-b8cc-659f53d5359c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:24.648283 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189be38-0aa8-4270-b8cc-659f53d5359c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:24.648557 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189be38-0aa8-4270-b8cc-659f53d5359c None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:24.649720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189be38-0aa8-4270-b8cc-659f53d5359c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:24.650022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189be38-0aa8-4270-b8cc-659f53d5359c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:24.651483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189be38-0aa8-4270-b8cc-659f53d5359c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:24.660357 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 472/948] 10.222.0.25 () {56 vars in 1122 bytes} [Sat Sep 24 19:19:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:24.662574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541190c0-ef46-4e52-a4eb-de46103f0a73 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:24.752506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:24.770984 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541190c0-ef46-4e52-a4eb-de46103f0a73 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:24.809112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b891ce-566f-46da-b31f-36530fd4465a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:24.809720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b891ce-566f-46da-b31f-36530fd4465a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:24.809999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b891ce-566f-46da-b31f-36530fd4465a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:24.810271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b891ce-566f-46da-b31f-36530fd4465a None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:24.810923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b891ce-566f-46da-b31f-36530fd4465a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:24.811281 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b891ce-566f-46da-b31f-36530fd4465a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:24.812769 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b891ce-566f-46da-b31f-36530fd4465a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:24.818117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 477/949] 10.222.0.25 () {56 vars in 1122 bytes} [Sat Sep 24 19:19:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:24.823780 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189be38-0aa8-4270-b8cc-659f53d5359c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:24.826866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:24.894757 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589ad36-c450-4459-a841-9b094864d93f None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:24.895077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589ad36-c450-4459-a841-9b094864d93f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:24.895457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589ad36-c450-4459-a841-9b094864d93f None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:24.897022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 478/950] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:19:24.904472 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb54cb2-bd18-4310-a466-4346fd66e0ab None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:24.904962 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb54cb2-bd18-4310-a466-4346fd66e0ab None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:24.905427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb54cb2-bd18-4310-a466-4346fd66e0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:24.927449 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-7fb54cb2-bd18-4310-a466-4346fd66e0ab None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:24.928795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7fb54cb2-bd18-4310-a466-4346fd66e0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:24.933344 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189be38-0aa8-4270-b8cc-659f53d5359c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:24.971176 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3c752-0059-48f8-b5ce-cdc29012adcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:24.971839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3c752-0059-48f8-b5ce-cdc29012adcc None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:24.972126 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3c752-0059-48f8-b5ce-cdc29012adcc None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:24.972397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3c752-0059-48f8-b5ce-cdc29012adcc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:24.973165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3c752-0059-48f8-b5ce-cdc29012adcc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:24.974569 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3c752-0059-48f8-b5ce-cdc29012adcc None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:24.999062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 473/951] 10.222.0.25 () {60 vars in 1144 bytes} [Sat Sep 24 19:19:24 2022] POST /identity/v3/endpoints => generated 349 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:19:25.011074 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 479/952] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:25.194958 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427e193-fa47-4791-abf1-379951f2fab5 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:25.195338 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427e193-fa47-4791-abf1-379951f2fab5 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:25.195442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427e193-fa47-4791-abf1-379951f2fab5 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:25.197795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 474/953] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:25.203054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66e13d-8d52-4084-b445-0583cd3252d1 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:25.203343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66e13d-8d52-4084-b445-0583cd3252d1 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:25.203617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66e13d-8d52-4084-b445-0583cd3252d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:25.222952 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-4c66e13d-8d52-4084-b445-0583cd3252d1 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:25.224137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4c66e13d-8d52-4084-b445-0583cd3252d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:25.284714 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427e193-fa47-4791-abf1-379951f2fab5 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:25.293625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 480/954] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:25.354802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:25.399661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427e193-fa47-4791-abf1-379951f2fab5 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:25.444566 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591c5ff-5136-44f2-9744-5bd7ce2ece7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:25.445677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591c5ff-5136-44f2-9744-5bd7ce2ece7b None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:25.446343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591c5ff-5136-44f2-9744-5bd7ce2ece7b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:25.447048 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591c5ff-5136-44f2-9744-5bd7ce2ece7b None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:25.447925 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591c5ff-5136-44f2-9744-5bd7ce2ece7b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:25.449564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591c5ff-5136-44f2-9744-5bd7ce2ece7b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:25.452480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: WARNING keystone.server.flask.common [None req-c591c5ff-5136-44f2-9744-5bd7ce2ece7b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 24 19:19:25.472615 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.sql.core [None req-c591c5ff-5136-44f2-9744-5bd7ce2ece7b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 24 19:19:25.472615 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 24 19:19:25.472615 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [parameters: {'id': '3ca535f094ec4dbcb3cba32c9a3a696a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 24 19:19:25.472615 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81421) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 24 19:19:25.480817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-c591c5ff-5136-44f2-9744-5bd7ce2ece7b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3ca535f094ec4dbcb3cba32c9a3a696a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3ca535f094ec4dbcb3cba32c9a3a696a. Sep 24 19:19:25.480817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:25.480817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 19:19:25.480817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 19:19:25.480817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 19:19:25.480817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 19:19:25.480817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 19:19:25.480817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 19:19:25.480817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 19:19:25.480817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application conn.query(q) Sep 24 19:19:25.480817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 19:19:25.480817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 19:19:25.480817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 19:19:25.481661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application result.read() Sep 24 19:19:25.481661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 19:19:25.481661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 19:19:25.481661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 19:19:25.481661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 19:19:25.481661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 19:19:25.481661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 19:19:25.481661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 19:19:25.481661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 19:19:25.481661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 24 19:19:25.481661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:25.481661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 24 19:19:25.481661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:25.481661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:25.481661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 24 19:19:25.481661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 24 19:19:25.481661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 24 19:19:25.481661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 24 19:19:25.482627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 19:19:25.482627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application next(self.gen) Sep 24 19:19:25.482627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 24 19:19:25.482627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application yield resource Sep 24 19:19:25.482627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 19:19:25.482627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application next(self.gen) Sep 24 19:19:25.482627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 24 19:19:25.482627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self.session.rollback() Sep 24 19:19:25.482627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 19:19:25.482627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self.force_reraise() Sep 24 19:19:25.482627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 19:19:25.482627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise self.value Sep 24 19:19:25.482627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 24 19:19:25.482627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 24 19:19:25.482627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 24 19:19:25.482627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application session.commit() Sep 24 19:19:25.482627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 24 19:19:25.483559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 24 19:19:25.483559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 24 19:19:25.483559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._prepare_impl() Sep 24 19:19:25.483559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 24 19:19:25.483559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self.session.flush() Sep 24 19:19:25.483559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 24 19:19:25.483559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._flush(objects) Sep 24 19:19:25.483559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 24 19:19:25.483559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 24 19:19:25.483559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 24 19:19:25.483559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application compat.raise_( Sep 24 19:19:25.483559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 19:19:25.483559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception Sep 24 19:19:25.483559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 24 19:19:25.483559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application flush_context.execute() Sep 24 19:19:25.483559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 24 19:19:25.483559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rec.execute(self) Sep 24 19:19:25.485137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 24 19:19:25.485137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 24 19:19:25.485137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 24 19:19:25.485137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 24 19:19:25.485137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 24 19:19:25.485137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 24 19:19:25.485137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 24 19:19:25.485137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 24 19:19:25.485137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 24 19:19:25.485137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 24 19:19:25.485137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 24 19:19:25.485137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 24 19:19:25.485137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 24 19:19:25.485137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 24 19:19:25.485137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 24 19:19:25.485927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 24 19:19:25.485927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 19:19:25.485927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception Sep 24 19:19:25.485927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 19:19:25.485927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 19:19:25.485927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 19:19:25.485927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 19:19:25.485927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 19:19:25.485927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 19:19:25.485927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 19:19:25.485927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application conn.query(q) Sep 24 19:19:25.485927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 19:19:25.485927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 19:19:25.485927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 19:19:25.485927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application result.read() Sep 24 19:19:25.485927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 19:19:25.485927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 19:19:25.487543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 19:19:25.487543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 19:19:25.487543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 19:19:25.487543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 19:19:25.487543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 19:19:25.487543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 19:19:25.487543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 24 19:19:25.487543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 24 19:19:25.487543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [parameters: {'id': '3ca535f094ec4dbcb3cba32c9a3a696a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 24 19:19:25.487543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 24 19:19:25.487543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:25.487543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:25.487543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:25.487543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:25.487543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 24 19:19:25.489480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 24 19:19:25.489480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 24 19:19:25.489480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 24 19:19:25.489480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 24 19:19:25.489480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:25.489480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:25.489480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:25.489480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:25.489480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:25.489480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:25.489480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:25.489480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:25.489480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:25.489480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:25.489480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:25.489480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:25.489480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:25.491876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:25.491876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 24 19:19:25.491876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 24 19:19:25.491876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:25.491876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:25.491876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 24 19:19:25.491876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 24 19:19:25.491876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3ca535f094ec4dbcb3cba32c9a3a696a. Sep 24 19:19:25.491876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:25.495445 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 475/955] 10.222.0.25 () {60 vars in 1140 bytes} [Sat Sep 24 19:19:25 2022] POST /identity/v3/projects => generated 262 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:25.504453 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66e13d-8d52-4084-b445-0583cd3252d1 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:25.506413 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:25.590874 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591c5ff-5136-44f2-9744-5bd7ce2ece7b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:25.619112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66e13d-8d52-4084-b445-0583cd3252d1 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:25.667551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4615067-18dc-4164-9eab-b5bb10ea9d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:25.668708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4615067-18dc-4164-9eab-b5bb10ea9d4e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:25.669144 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4615067-18dc-4164-9eab-b5bb10ea9d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:25.669586 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4615067-18dc-4164-9eab-b5bb10ea9d4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:25.679224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4615067-18dc-4164-9eab-b5bb10ea9d4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:25.681039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4615067-18dc-4164-9eab-b5bb10ea9d4e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:25.697225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-c4615067-18dc-4164-9eab-b5bb10ea9d4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:25.697225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:25.697225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:25.697225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:25.697225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:25.697225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:25.697225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:25.697225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:25.697225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:25.697225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:25.697225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:25.697225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:25.697225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:19:25.697225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:19:25.697225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:19:25.698349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:19:25.698349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:25.698349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:25.698349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:25.698349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:25.698349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:25.698349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:25.698349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:25.698349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:25.698349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:25.698349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:25.698349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:25.698349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:25.698349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:25.698349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:25.698349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:25.698349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:25.699563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:19:25.699563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:19:25.699563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:19:25.699563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:19:25.699563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:19:25.699563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:19:25.699563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:25.699563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:25.702400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 481/956] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:19:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:25.707609 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4615067-18dc-4164-9eab-b5bb10ea9d4e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:25.720018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591c5ff-5136-44f2-9744-5bd7ce2ece7b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:25.736622 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:25.760646 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8469f1-05cf-44aa-8147-4ba085ddc586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:25.761560 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8469f1-05cf-44aa-8147-4ba085ddc586 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:25.761560 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8469f1-05cf-44aa-8147-4ba085ddc586 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:25.761850 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8469f1-05cf-44aa-8147-4ba085ddc586 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:25.762422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8469f1-05cf-44aa-8147-4ba085ddc586 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:25.764008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8469f1-05cf-44aa-8147-4ba085ddc586 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:25.772956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-4c8469f1-05cf-44aa-8147-4ba085ddc586 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:19:25.772956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:25.772956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:19:25.772956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:19:25.772956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:19:25.772956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:19:25.772956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:19:25.772956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:25.772956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:19:25.772956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:25.772956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:25.772956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:25.772956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:25.772956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:25.772956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:25.772956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:25.772956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:25.774370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:25.774370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:25.774370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:25.774370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:25.774370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:25.774370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:25.774370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:19:25.774370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:19:25.774370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:19:25.774370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:19:25.774370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:25.774370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:25.774370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:25.774370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:25.774370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:25.774370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:25.775826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:25.775826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:25.775826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:25.775826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:25.775826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:25.775826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:25.775826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:25.775826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:25.775826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:25.775826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:25.775826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:19:25.775826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:25.775826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:19:25.775826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:25.775826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 476/957] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:19:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:25.776657 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e984258-0465-4605-b257-0f834537c0d3 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:25.776657 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e984258-0465-4605-b257-0f834537c0d3 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:25.776657 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e984258-0465-4605-b257-0f834537c0d3 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:25.780938 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 477/958] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:25.781652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e984258-0465-4605-b257-0f834537c0d3 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:25.785768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:25.832105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4615067-18dc-4164-9eab-b5bb10ea9d4e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:25.868776 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070466b1-001f-4a4f-be0f-f96238641a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:25.869533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070466b1-001f-4a4f-be0f-f96238641a4b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:25.869816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070466b1-001f-4a4f-be0f-f96238641a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:25.870187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070466b1-001f-4a4f-be0f-f96238641a4b None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:25.870851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070466b1-001f-4a4f-be0f-f96238641a4b None admin] RBAC: Adding query filter params (name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:25.871159 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070466b1-001f-4a4f-be0f-f96238641a4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:25.872742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070466b1-001f-4a4f-be0f-f96238641a4b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:25.889318 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e984258-0465-4605-b257-0f834537c0d3 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:25.891771 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 482/959] 10.222.0.25 () {56 vars in 1112 bytes} [Sat Sep 24 19:19:25 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:25.893525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddf155-d912-4110-be57-364815eb2206 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:25.893951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddf155-d912-4110-be57-364815eb2206 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:25.894401 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddf155-d912-4110-be57-364815eb2206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:25.921778 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-a6ddf155-d912-4110-be57-364815eb2206 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:25.923586 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a6ddf155-d912-4110-be57-364815eb2206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:25.946537 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab21584-703c-419a-b0d5-de263250e26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:25.947428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab21584-703c-419a-b0d5-de263250e26a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:25.947638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab21584-703c-419a-b0d5-de263250e26a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:25.947909 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab21584-703c-419a-b0d5-de263250e26a None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:25.948575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab21584-703c-419a-b0d5-de263250e26a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:25.948876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab21584-703c-419a-b0d5-de263250e26a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:25.950302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab21584-703c-419a-b0d5-de263250e26a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:25.960758 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 478/960] 10.222.0.25 () {56 vars in 1112 bytes} [Sat Sep 24 19:19:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:25.962754 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab21584-703c-419a-b0d5-de263250e26a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:26.014530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:26.026861 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 483/961] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:26.086507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab21584-703c-419a-b0d5-de263250e26a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:26.123194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f3895-1d76-4c9f-b2aa-72dbd5ce39f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:26.123807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f3895-1d76-4c9f-b2aa-72dbd5ce39f7 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:26.124081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f3895-1d76-4c9f-b2aa-72dbd5ce39f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:26.124398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f3895-1d76-4c9f-b2aa-72dbd5ce39f7 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:26.125022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f3895-1d76-4c9f-b2aa-72dbd5ce39f7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:26.125317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f3895-1d76-4c9f-b2aa-72dbd5ce39f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:26.126667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f3895-1d76-4c9f-b2aa-72dbd5ce39f7 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:26.131730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 479/962] 10.222.0.25 () {56 vars in 1112 bytes} [Sat Sep 24 19:19:25 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:26.304574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddf155-d912-4110-be57-364815eb2206 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:26.364655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:26.415060 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddf155-d912-4110-be57-364815eb2206 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:26.460037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39d1f2-c9b0-4721-af02-27ee5f47b071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:26.460664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39d1f2-c9b0-4721-af02-27ee5f47b071 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:26.460939 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39d1f2-c9b0-4721-af02-27ee5f47b071 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:26.461820 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39d1f2-c9b0-4721-af02-27ee5f47b071 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:26.472320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39d1f2-c9b0-4721-af02-27ee5f47b071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:19:26.477178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-2a39d1f2-c9b0-4721-af02-27ee5f47b071 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:19:26.477178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:26.477178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:26.477178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:26.477178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:26.477178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:26.477178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:26.477178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:26.477178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:26.477178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:26.477178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:26.477178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:26.477178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:19:26.477178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:19:26.477178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:19:26.477178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:19:26.478158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:19:26.478158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:19:26.478158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:19:26.478158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:19:26.478158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:26.478158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:26.478158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:26.478158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:26.478158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:26.478158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:26.478158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:26.478158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:26.478158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:26.478158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:26.478158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:26.478158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:26.479067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:26.479067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:26.479067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:26.479067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:26.479067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:19:26.479067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:19:26.479067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:19:26.479067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:19:26.479067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:19:26.479067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:19:26.479067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:19:26.479067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:26.479067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 484/963] 10.222.0.25 () {56 vars in 1120 bytes} [Sat Sep 24 19:19:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:26.484469 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f3895-1d76-4c9f-b2aa-72dbd5ce39f7 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:26.592266 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f3895-1d76-4c9f-b2aa-72dbd5ce39f7 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:26.599761 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:26.628785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7467cd-4f28-476f-a589-525678554506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:26.629386 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7467cd-4f28-476f-a589-525678554506 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:26.629840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7467cd-4f28-476f-a589-525678554506 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:26.630132 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7467cd-4f28-476f-a589-525678554506 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:26.630799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7467cd-4f28-476f-a589-525678554506 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:26.631125 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7467cd-4f28-476f-a589-525678554506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:26.632473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7467cd-4f28-476f-a589-525678554506 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:26.641774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 480/964] 10.222.0.25 () {56 vars in 1115 bytes} [Sat Sep 24 19:19:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:26.648103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39d1f2-c9b0-4721-af02-27ee5f47b071 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:26.760474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39d1f2-c9b0-4721-af02-27ee5f47b071 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:26.776369 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:26.798509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae0805-e970-48c1-ab4e-97e72df76b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:26.799503 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae0805-e970-48c1-ab4e-97e72df76b37 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:26.799990 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae0805-e970-48c1-ab4e-97e72df76b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:26.800484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae0805-e970-48c1-ab4e-97e72df76b37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:26.812107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae0805-e970-48c1-ab4e-97e72df76b37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:26.813824 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae0805-e970-48c1-ab4e-97e72df76b37 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:26.829130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-9bae0805-e970-48c1-ab4e-97e72df76b37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:26.829130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:26.829130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:26.829130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:26.829130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:26.829130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:26.829130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:26.829130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:26.829130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:26.829130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:26.829130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:26.829130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:26.829130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:26.829130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:26.829130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:26.829130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:26.830115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:26.830115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:26.830115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:26.830115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:26.830115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:26.830115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:26.830115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:26.830115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:26.830115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:26.830115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:26.830115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:26.830115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:26.830115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:26.830115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:26.830115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:26.830115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:26.830115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:26.831044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:26.831044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:26.831044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:26.833081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 485/965] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:26.839472 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7467cd-4f28-476f-a589-525678554506 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:26.947819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7467cd-4f28-476f-a589-525678554506 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:26.982663 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383cdab-854c-4422-8064-81969a28226e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:26.983398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383cdab-854c-4422-8064-81969a28226e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:26.983812 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383cdab-854c-4422-8064-81969a28226e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:26.984082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383cdab-854c-4422-8064-81969a28226e None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:26.984714 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383cdab-854c-4422-8064-81969a28226e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:26.985011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383cdab-854c-4422-8064-81969a28226e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:26.986562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383cdab-854c-4422-8064-81969a28226e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:26.999328 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 481/966] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:27.005123 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae0805-e970-48c1-ab4e-97e72df76b37 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:27.109309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae0805-e970-48c1-ab4e-97e72df76b37 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:27.149534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a188eb-6e57-404c-b2af-8741cff2bcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:27.150267 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a188eb-6e57-404c-b2af-8741cff2bcae None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:27.150614 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a188eb-6e57-404c-b2af-8741cff2bcae None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:27.150908 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a188eb-6e57-404c-b2af-8741cff2bcae None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:27.160047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a188eb-6e57-404c-b2af-8741cff2bcae None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:27.161606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a188eb-6e57-404c-b2af-8741cff2bcae None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:27.174764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-30a188eb-6e57-404c-b2af-8741cff2bcae None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:19:27.174764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:27.174764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:27.174764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:27.174764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:27.174764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:27.174764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:27.174764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:27.174764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:27.174764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:27.174764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:27.174764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:27.174764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:19:27.174764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:19:27.174764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:19:27.174764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:19:27.175821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:27.175821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:27.175821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:19:27.175821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:27.175821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:19:27.175821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:27.175821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:27.175821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:27.175821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:27.175821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:27.175821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:27.175821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:27.175821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:27.175821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:27.175821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:27.175821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:27.175821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:27.175821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:27.176833 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:27.176833 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:27.176833 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:19:27.176833 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:19:27.176833 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:19:27.176833 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:19:27.176833 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:19:27.176833 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:19:27.176833 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 19:19:27.176833 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:27.176833 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 486/967] 10.222.0.25 () {56 vars in 1117 bytes} [Sat Sep 24 19:19:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:27.182405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383cdab-854c-4422-8064-81969a28226e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:27.227850 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:27.259612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2b767-269c-4eee-86a2-83e6675033dc None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:27.259958 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2b767-269c-4eee-86a2-83e6675033dc None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:27.260178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2b767-269c-4eee-86a2-83e6675033dc None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:27.262337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 487/968] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:19:27.268123 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea48fc9-d752-4227-b5d1-2c71ad88f50d None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:27.268401 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea48fc9-d752-4227-b5d1-2c71ad88f50d None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:27.268669 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea48fc9-d752-4227-b5d1-2c71ad88f50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:27.290391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383cdab-854c-4422-8064-81969a28226e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:27.292145 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-0ea48fc9-d752-4227-b5d1-2c71ad88f50d None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:27.294167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-0ea48fc9-d752-4227-b5d1-2c71ad88f50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:27.325132 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:27.326337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9b0eb-3c70-4150-912d-5c409cf7bc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:27.326978 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9b0eb-3c70-4150-912d-5c409cf7bc68 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:27.327262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9b0eb-3c70-4150-912d-5c409cf7bc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:27.327537 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9b0eb-3c70-4150-912d-5c409cf7bc68 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:27.328268 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9b0eb-3c70-4150-912d-5c409cf7bc68 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:27.328575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9b0eb-3c70-4150-912d-5c409cf7bc68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:27.330001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9b0eb-3c70-4150-912d-5c409cf7bc68 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:27.355282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 482/969] 10.222.0.25 () {56 vars in 1149 bytes} [Sat Sep 24 19:19:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:27.356257 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9b0eb-3c70-4150-912d-5c409cf7bc68 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:27.386874 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 488/970] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:27.459108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:27.475460 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9b0eb-3c70-4150-912d-5c409cf7bc68 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:27.512990 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e48932-6e80-40cd-982d-684eba854807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:27.513590 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e48932-6e80-40cd-982d-684eba854807 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:27.513863 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e48932-6e80-40cd-982d-684eba854807 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:27.514130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e48932-6e80-40cd-982d-684eba854807 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:27.587643 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e48932-6e80-40cd-982d-684eba854807 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:27.589142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e48932-6e80-40cd-982d-684eba854807 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:27.674321 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:27.691730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 483/971] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:19:27 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:19:27.697373 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea48fc9-d752-4227-b5d1-2c71ad88f50d None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:27.707992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e48932-6e80-40cd-982d-684eba854807 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:27.812743 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea48fc9-d752-4227-b5d1-2c71ad88f50d None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:27.813820 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e48932-6e80-40cd-982d-684eba854807 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:27.850078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87c93a-c779-4520-aed9-bb30de5157b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:27.850703 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87c93a-c779-4520-aed9-bb30de5157b6 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:27.851064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87c93a-c779-4520-aed9-bb30de5157b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:27.851173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d1e7d-1cab-443f-830a-f83b765763db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:27.851352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87c93a-c779-4520-aed9-bb30de5157b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:27.851789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d1e7d-1cab-443f-830a-f83b765763db None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:27.852480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d1e7d-1cab-443f-830a-f83b765763db None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:27.852835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d1e7d-1cab-443f-830a-f83b765763db None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:27.853525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d1e7d-1cab-443f-830a-f83b765763db None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:27.855037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d1e7d-1cab-443f-830a-f83b765763db None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:27.861874 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87c93a-c779-4520-aed9-bb30de5157b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:27.863323 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87c93a-c779-4520-aed9-bb30de5157b6 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:27.864409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-bc6d1e7d-1cab-443f-830a-f83b765763db None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:19:27.864409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:27.864409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:19:27.864409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:19:27.864409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:19:27.864409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:19:27.864409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:19:27.864409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:27.864409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:19:27.864409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:27.864409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:27.864409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:27.864409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:27.864409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:27.864409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:27.864409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:27.864409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:27.865391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:27.865391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:27.865391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:27.865391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:27.865391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:27.865391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:27.865391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:19:27.865391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:19:27.865391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:19:27.865391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:19:27.865391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:27.865391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:27.865391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:27.865391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:27.865391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:27.865391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:27.866253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:27.866253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:27.866253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:27.866253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:27.866253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:27.866253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:27.866253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:27.866253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:27.866253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:27.866253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:27.866253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:19:27.866253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:27.866253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:19:27.866253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:27.871287 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 484/972] 10.222.0.25 () {56 vars in 1126 bytes} [Sat Sep 24 19:19:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:27.872736 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d1e7d-1cab-443f-830a-f83b765763db None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:27.880044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-8d87c93a-c779-4520-aed9-bb30de5157b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:27.880044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:27.880044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:27.880044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:27.880044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:27.880044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:27.880044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:27.880044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:27.880044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:27.880044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:27.880044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:27.880044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:27.880044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:27.880044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:27.880044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:27.880044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:27.881029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:27.881029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:27.881029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:27.881029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:27.881029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:27.881029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:27.881029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:27.881029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:27.881029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:27.881029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:27.881029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:27.881029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:27.881029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:27.881029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:27.881029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:27.881029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:27.881029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:27.881943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:27.881943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:27.881943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:27.886809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 489/973] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:27.887846 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87c93a-c779-4520-aed9-bb30de5157b6 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:27.903193 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:27.928839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:27.994483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d1e7d-1cab-443f-830a-f83b765763db None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:28.015210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87c93a-c779-4520-aed9-bb30de5157b6 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:28.040486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56580a71-6251-40d2-9204-474a2ae1c750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:28.041612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56580a71-6251-40d2-9204-474a2ae1c750 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:28.042279 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56580a71-6251-40d2-9204-474a2ae1c750 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:28.042698 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56580a71-6251-40d2-9204-474a2ae1c750 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:28.044022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56580a71-6251-40d2-9204-474a2ae1c750 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:28.044575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56580a71-6251-40d2-9204-474a2ae1c750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:28.046802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56580a71-6251-40d2-9204-474a2ae1c750 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:28.053381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 485/974] 10.222.0.25 () {56 vars in 1122 bytes} [Sat Sep 24 19:19:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:28.059940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56580a71-6251-40d2-9204-474a2ae1c750 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:28.060133 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8cb4d-6b77-4536-9aec-5c14ce7ab9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:28.060966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8cb4d-6b77-4536-9aec-5c14ce7ab9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:28.061389 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8cb4d-6b77-4536-9aec-5c14ce7ab9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:28.061742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8cb4d-6b77-4536-9aec-5c14ce7ab9b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:28.062426 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8cb4d-6b77-4536-9aec-5c14ce7ab9b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:28.063692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8cb4d-6b77-4536-9aec-5c14ce7ab9b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:28.064673 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8cb4d-6b77-4536-9aec-5c14ce7ab9b7 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:28.078869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 490/975] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:28.084404 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8cb4d-6b77-4536-9aec-5c14ce7ab9b7 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:28.173980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:28.203318 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56580a71-6251-40d2-9204-474a2ae1c750 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:28.217414 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8cb4d-6b77-4536-9aec-5c14ce7ab9b7 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:28.218991 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:28.240919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacf0c2-dd16-4bb4-8eba-fc54d46a1e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:28.241527 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacf0c2-dd16-4bb4-8eba-fc54d46a1e9e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:28.241801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacf0c2-dd16-4bb4-8eba-fc54d46a1e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:28.242067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacf0c2-dd16-4bb4-8eba-fc54d46a1e9e None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:28.243084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacf0c2-dd16-4bb4-8eba-fc54d46a1e9e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:28.243535 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacf0c2-dd16-4bb4-8eba-fc54d46a1e9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:28.244910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bacf0c2-dd16-4bb4-8eba-fc54d46a1e9e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:28.249760 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 486/976] 10.222.0.25 () {56 vars in 1122 bytes} [Sat Sep 24 19:19:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:28.251012 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa600060-40fb-40f5-acaf-9f8068fd6465 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:28.251293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa600060-40fb-40f5-acaf-9f8068fd6465 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:28.251563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa600060-40fb-40f5-acaf-9f8068fd6465 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:28.256691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 487/977] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:28.256691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa600060-40fb-40f5-acaf-9f8068fd6465 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:28.261061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b835d4-fd21-46b1-92ef-96be4f910726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:28.261704 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b835d4-fd21-46b1-92ef-96be4f910726 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:28.261983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b835d4-fd21-46b1-92ef-96be4f910726 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:28.262256 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b835d4-fd21-46b1-92ef-96be4f910726 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:28.269408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b835d4-fd21-46b1-92ef-96be4f910726 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:28.270869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b835d4-fd21-46b1-92ef-96be4f910726 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:28.282842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-c2b835d4-fd21-46b1-92ef-96be4f910726 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:28.282842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:28.282842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:28.282842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:28.282842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:28.282842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:28.282842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:28.282842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:28.282842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:28.282842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:28.282842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:28.282842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:28.282842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:19:28.282842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:19:28.282842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:19:28.283775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:19:28.283775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:28.283775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:28.283775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:28.283775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:28.283775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:28.283775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:28.283775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:28.283775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:28.283775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:28.283775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:28.283775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:28.283775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:28.283775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:28.283775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:28.283775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:28.283775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:28.284673 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:19:28.284673 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:19:28.284673 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:19:28.284673 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:19:28.284673 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:19:28.284673 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:19:28.284673 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:28.284673 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:28.284673 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 491/978] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:19:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:28.288373 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb22deb-941e-4bdb-88a7-765c8a60e505 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:28.289164 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb22deb-941e-4bdb-88a7-765c8a60e505 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:28.289991 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb22deb-941e-4bdb-88a7-765c8a60e505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:28.313817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-5eb22deb-941e-4bdb-88a7-765c8a60e505 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:28.315733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5eb22deb-941e-4bdb-88a7-765c8a60e505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:28.364921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa600060-40fb-40f5-acaf-9f8068fd6465 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:28.397767 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 492/979] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:28.399318 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb22deb-941e-4bdb-88a7-765c8a60e505 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:28.421577 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b77af-0602-4c5e-b021-50684d4904e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:28.422471 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b77af-0602-4c5e-b021-50684d4904e1 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:28.423049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b77af-0602-4c5e-b021-50684d4904e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:28.423542 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b77af-0602-4c5e-b021-50684d4904e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:28.424510 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b77af-0602-4c5e-b021-50684d4904e1 None admin] RBAC: Adding query filter params (interface=admin, service_id=cc40d02369c445f2851ea6149dda4f79, region_id=RegionOne) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:28.425024 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b77af-0602-4c5e-b021-50684d4904e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:28.426718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b77af-0602-4c5e-b021-50684d4904e1 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:28.433761 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 488/980] 10.222.0.25 () {56 vars in 1249 bytes} [Sat Sep 24 19:19:28 2022] GET /identity/v3/endpoints?service_id=cc40d02369c445f2851ea6149dda4f79&interface=admin®ion_id=RegionOne => generated 193 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:28.440191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b77af-0602-4c5e-b021-50684d4904e1 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:28.478162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:28.491850 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:28.522874 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb22deb-941e-4bdb-88a7-765c8a60e505 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:28.555420 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b77af-0602-4c5e-b021-50684d4904e1 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:28.558654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a3fed-8192-4b9f-a59b-49ce744bbb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:28.559299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a3fed-8192-4b9f-a59b-49ce744bbb0f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:28.559578 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a3fed-8192-4b9f-a59b-49ce744bbb0f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:28.559850 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a3fed-8192-4b9f-a59b-49ce744bbb0f None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:28.560535 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a3fed-8192-4b9f-a59b-49ce744bbb0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:28.560841 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a3fed-8192-4b9f-a59b-49ce744bbb0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:28.562265 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a3fed-8192-4b9f-a59b-49ce744bbb0f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:28.575936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 493/981] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:19:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:28.576930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537437d1-ef90-416a-b837-1706974238a4 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:28.577307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537437d1-ef90-416a-b837-1706974238a4 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:28.577475 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537437d1-ef90-416a-b837-1706974238a4 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:28.580762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 494/982] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:28.582018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537437d1-ef90-416a-b837-1706974238a4 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:28.595844 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad35f8e-9f10-4a59-886d-9c4a93b3e61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:28.596456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad35f8e-9f10-4a59-886d-9c4a93b3e61f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:28.596736 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad35f8e-9f10-4a59-886d-9c4a93b3e61f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:28.597040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad35f8e-9f10-4a59-886d-9c4a93b3e61f None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:28.597612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad35f8e-9f10-4a59-886d-9c4a93b3e61f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:28.599019 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad35f8e-9f10-4a59-886d-9c4a93b3e61f None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:28.614871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 489/983] 10.222.0.25 () {56 vars in 1087 bytes} [Sat Sep 24 19:19:28 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:19:28.614871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aef4d3-3b7e-44d7-92dd-7278770c9de8 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:28.614871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aef4d3-3b7e-44d7-92dd-7278770c9de8 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:28.614871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aef4d3-3b7e-44d7-92dd-7278770c9de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:28.636913 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-c8aef4d3-3b7e-44d7-92dd-7278770c9de8 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:28.639210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c8aef4d3-3b7e-44d7-92dd-7278770c9de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:28.716913 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537437d1-ef90-416a-b837-1706974238a4 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:28.719079 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 490/984] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:28.719079 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aef4d3-3b7e-44d7-92dd-7278770c9de8 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:28.738754 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:28.766395 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644c814-4ff9-48a2-a3cc-16e8d8979e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:28.767699 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644c814-4ff9-48a2-a3cc-16e8d8979e29 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:28.768136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644c814-4ff9-48a2-a3cc-16e8d8979e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:28.768576 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644c814-4ff9-48a2-a3cc-16e8d8979e29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:28.769513 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644c814-4ff9-48a2-a3cc-16e8d8979e29 None admin] RBAC: Adding query filter params (role.id=c350cad9e8c64a188a5f0b2bafe29a40, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=7c398cf6318240f09d2c3b62bc6761d5) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:28.770038 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644c814-4ff9-48a2-a3cc-16e8d8979e29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:28.770784 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:28.772505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644c814-4ff9-48a2-a3cc-16e8d8979e29 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:28.781965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 495/985] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:19:28 2022] GET /identity/v3/role_assignments?user.id=7c398cf6318240f09d2c3b62bc6761d5&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=c350cad9e8c64a188a5f0b2bafe29a40 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:28.857193 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aef4d3-3b7e-44d7-92dd-7278770c9de8 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:28.896946 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8244fa-ef61-45c6-a11c-a67636e923cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:28.897581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8244fa-ef61-45c6-a11c-a67636e923cd None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:28.897858 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8244fa-ef61-45c6-a11c-a67636e923cd None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:28.898131 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8244fa-ef61-45c6-a11c-a67636e923cd None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:28.899198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8244fa-ef61-45c6-a11c-a67636e923cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:28.900861 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8244fa-ef61-45c6-a11c-a67636e923cd None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:28.917935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.sql.core [None req-3b8244fa-ef61-45c6-a11c-a67636e923cd None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 24 19:19:28.917935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 24 19:19:28.917935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [parameters: {'user_id': '96496e624bb54dce903916023b0a2492', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 24 19:19:28.917935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81421) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 24 19:19:28.925040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-3b8244fa-ef61-45c6-a11c-a67636e923cd None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 24 19:19:28.925040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:28.925040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 19:19:28.925040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 19:19:28.925040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 19:19:28.925040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 19:19:28.925040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 19:19:28.925040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 19:19:28.925040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 19:19:28.925040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application conn.query(q) Sep 24 19:19:28.925040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 19:19:28.925040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 19:19:28.925040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 19:19:28.925040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application result.read() Sep 24 19:19:28.925040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 19:19:28.926056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 19:19:28.926056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 19:19:28.926056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 19:19:28.926056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 19:19:28.926056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 19:19:28.926056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 19:19:28.926056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 19:19:28.926056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 24 19:19:28.926056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:28.926056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 24 19:19:28.926056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:28.926056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:28.926056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 24 19:19:28.926056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 24 19:19:28.926056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 24 19:19:28.926056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 24 19:19:28.926056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 19:19:28.926056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application next(self.gen) Sep 24 19:19:28.927078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 24 19:19:28.927078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application yield resource Sep 24 19:19:28.927078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 19:19:28.927078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application next(self.gen) Sep 24 19:19:28.927078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 24 19:19:28.927078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self.session.rollback() Sep 24 19:19:28.927078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 19:19:28.927078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self.force_reraise() Sep 24 19:19:28.927078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 19:19:28.927078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise self.value Sep 24 19:19:28.927078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 24 19:19:28.927078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 24 19:19:28.927078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 24 19:19:28.927078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application session.commit() Sep 24 19:19:28.927078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 24 19:19:28.927078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 24 19:19:28.927078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 24 19:19:28.928008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._prepare_impl() Sep 24 19:19:28.928008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 24 19:19:28.928008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self.session.flush() Sep 24 19:19:28.928008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 24 19:19:28.928008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._flush(objects) Sep 24 19:19:28.928008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 24 19:19:28.928008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 24 19:19:28.928008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 24 19:19:28.928008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application compat.raise_( Sep 24 19:19:28.928008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 19:19:28.928008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception Sep 24 19:19:28.928008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 24 19:19:28.928008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application flush_context.execute() Sep 24 19:19:28.928008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 24 19:19:28.928008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rec.execute(self) Sep 24 19:19:28.928008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 24 19:19:28.928008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 24 19:19:28.928931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 24 19:19:28.928931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 24 19:19:28.928931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 24 19:19:28.928931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 24 19:19:28.928931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 24 19:19:28.928931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 24 19:19:28.928931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 24 19:19:28.928931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 24 19:19:28.928931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 24 19:19:28.928931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 24 19:19:28.928931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 24 19:19:28.928931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 24 19:19:28.928931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 24 19:19:28.928931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 24 19:19:28.928931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 19:19:28.928931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception Sep 24 19:19:28.929880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 19:19:28.929880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 19:19:28.929880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 19:19:28.929880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 19:19:28.929880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 19:19:28.929880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 19:19:28.929880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 19:19:28.929880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application conn.query(q) Sep 24 19:19:28.929880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 19:19:28.929880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 19:19:28.929880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 19:19:28.929880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application result.read() Sep 24 19:19:28.929880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 19:19:28.929880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 19:19:28.929880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 19:19:28.929880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 19:19:28.931534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 19:19:28.931534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 19:19:28.931534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 19:19:28.931534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 19:19:28.931534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 24 19:19:28.931534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 24 19:19:28.931534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [parameters: {'user_id': '96496e624bb54dce903916023b0a2492', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 24 19:19:28.931534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 24 19:19:28.931534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:28.931534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:28.931534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:28.931534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:28.931534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:28.931534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:28.931534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:28.934543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:28.934543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:28.934543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:28.934543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:28.934543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:28.934543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:28.934543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:28.934543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 24 19:19:28.934543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 24 19:19:28.934543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:28.934543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:28.934543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:19:28.934543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:28.934543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:19:28.934543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:28.934543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 24 19:19:28.934543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 24 19:19:28.936745 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 24 19:19:28.936745 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 24 19:19:28.936745 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 24 19:19:28.936745 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 24 19:19:28.936745 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 24 19:19:28.936745 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:28.936745 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 491/986] 10.222.0.25 () {60 vars in 1131 bytes} [Sat Sep 24 19:19:28 2022] POST /identity/v3/users => generated 160 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:28.937652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644c814-4ff9-48a2-a3cc-16e8d8979e29 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:29.007098 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8244fa-ef61-45c6-a11c-a67636e923cd None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:29.054561 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644c814-4ff9-48a2-a3cc-16e8d8979e29 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:29.099006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff3256-179b-4383-bc15-5bfc2c2e67b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:29.100372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff3256-179b-4383-bc15-5bfc2c2e67b1 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:29.100951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff3256-179b-4383-bc15-5bfc2c2e67b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:29.101393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff3256-179b-4383-bc15-5bfc2c2e67b1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:29.111458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff3256-179b-4383-bc15-5bfc2c2e67b1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:29.113188 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff3256-179b-4383-bc15-5bfc2c2e67b1 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:29.127716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-59ff3256-179b-4383-bc15-5bfc2c2e67b1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:19:29.127716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:29.127716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:29.127716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:29.127716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:29.127716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:29.127716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:29.127716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:29.127716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:29.127716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:29.127716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:29.127716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:29.127716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:19:29.127716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:19:29.127716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:19:29.127716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:19:29.128710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:29.128710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:29.128710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:19:29.128710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:29.128710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:19:29.128710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:29.128710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:29.128710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:29.128710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:29.128710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:29.128710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:29.128710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:29.128710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:29.128710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:29.128710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:29.128710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:29.128710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:29.128710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:29.129670 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:29.129670 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:29.129670 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:19:29.129670 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:19:29.129670 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:19:29.129670 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:19:29.129670 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:19:29.129670 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:19:29.129670 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:19:29.129670 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:29.132460 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 496/987] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:19:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:29.138176 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff3256-179b-4383-bc15-5bfc2c2e67b1 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:29.146184 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:29.152581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8244fa-ef61-45c6-a11c-a67636e923cd None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:29.193094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:29.201406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858c94e-d2df-480c-b5d2-cb805bdee9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:29.202257 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858c94e-d2df-480c-b5d2-cb805bdee9fa None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:29.202780 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858c94e-d2df-480c-b5d2-cb805bdee9fa None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:29.203236 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858c94e-d2df-480c-b5d2-cb805bdee9fa None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:29.204176 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858c94e-d2df-480c-b5d2-cb805bdee9fa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:29.205910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858c94e-d2df-480c-b5d2-cb805bdee9fa None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:29.232035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 492/988] 10.222.0.25 () {60 vars in 1141 bytes} [Sat Sep 24 19:19:29 2022] POST /identity/v3/services => generated 242 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:19:29.263134 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff3256-179b-4383-bc15-5bfc2c2e67b1 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:29.311692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc9597-9b6f-4ee5-9c89-c981ae36b9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:29.312611 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc9597-9b6f-4ee5-9c89-c981ae36b9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:29.313040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc9597-9b6f-4ee5-9c89-c981ae36b9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:29.313470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc9597-9b6f-4ee5-9c89-c981ae36b9a0 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:29.314343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc9597-9b6f-4ee5-9c89-c981ae36b9a0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:29.314798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc9597-9b6f-4ee5-9c89-c981ae36b9a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:29.316439 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc9597-9b6f-4ee5-9c89-c981ae36b9a0 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:29.356380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 497/989] 10.222.0.25 () {56 vars in 1101 bytes} [Sat Sep 24 19:19:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:30.988757 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadea482-2587-46bf-9fc7-ca01865f831e None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:30.989286 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadea482-2587-46bf-9fc7-ca01865f831e None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:30.989286 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadea482-2587-46bf-9fc7-ca01865f831e None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:30.990720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 493/990] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:30.996350 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2831036-1a74-47d9-9046-d353f3a7b816 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:30.996777 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2831036-1a74-47d9-9046-d353f3a7b816 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:30.996964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2831036-1a74-47d9-9046-d353f3a7b816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:31.015965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-e2831036-1a74-47d9-9046-d353f3a7b816 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:31.017141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e2831036-1a74-47d9-9046-d353f3a7b816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:31.027872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046847c-2779-4691-8112-c57476bcea38 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:31.028160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046847c-2779-4691-8112-c57476bcea38 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:31.028440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046847c-2779-4691-8112-c57476bcea38 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:31.030029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 494/991] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:31.034842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed53fbe-4081-402b-8961-078a856c820d None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:31.035146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed53fbe-4081-402b-8961-078a856c820d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:31.035423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed53fbe-4081-402b-8961-078a856c820d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:31.054816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-bed53fbe-4081-402b-8961-078a856c820d None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:31.054816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-bed53fbe-4081-402b-8961-078a856c820d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:31.094872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 498/992] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:30 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:31.129088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 495/993] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:19:31.374173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2831036-1a74-47d9-9046-d353f3a7b816 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:31.403667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed53fbe-4081-402b-8961-078a856c820d None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:31.404767 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:31.491292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2831036-1a74-47d9-9046-d353f3a7b816 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:31.494023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:31.506930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed53fbe-4081-402b-8961-078a856c820d None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:31.528427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145759b-c5d7-40bc-a8c0-ccfc48590149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:31.529046 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145759b-c5d7-40bc-a8c0-ccfc48590149 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:31.529326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145759b-c5d7-40bc-a8c0-ccfc48590149 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:31.529596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145759b-c5d7-40bc-a8c0-ccfc48590149 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:31.530161 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145759b-c5d7-40bc-a8c0-ccfc48590149 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:31.531565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145759b-c5d7-40bc-a8c0-ccfc48590149 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:31.540331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-f145759b-c5d7-40bc-a8c0-ccfc48590149 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:19:31.540331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:31.540331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:19:31.540331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:19:31.540331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:19:31.540331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:19:31.540331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:19:31.540331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:31.540331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:19:31.540331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:31.540331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:31.540331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:31.540331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:31.540331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:31.540331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:31.540331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:31.540331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:31.541431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:31.541431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:31.541431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:31.541431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:31.541431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:31.541431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:31.541431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:19:31.541431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:19:31.541431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:19:31.541431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:19:31.541431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:31.541431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:31.541431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:31.541431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:31.541431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:31.541431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:31.542276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:31.542276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:31.542276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:31.542276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:31.542276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:31.542276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:31.542276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:31.542276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:31.542276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:31.542276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:31.542276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:19:31.542276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:31.542276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 19:19:31.542276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:31.542276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 499/994] 10.222.0.25 () {56 vars in 1126 bytes} [Sat Sep 24 19:19:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:31.543122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff296c-5830-4f39-b57c-b2b8bec23c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:31.543122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff296c-5830-4f39-b57c-b2b8bec23c7c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:31.543267 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d12335-4712-44d2-a6be-d2eafb4f46d7 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:31.543350 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff296c-5830-4f39-b57c-b2b8bec23c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:31.543423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d12335-4712-44d2-a6be-d2eafb4f46d7 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:31.543507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff296c-5830-4f39-b57c-b2b8bec23c7c None admin] PATH_INFO: `/v3/services/image` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:31.543579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d12335-4712-44d2-a6be-d2eafb4f46d7 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:31.543655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff296c-5830-4f39-b57c-b2b8bec23c7c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:31.546779 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 500/995] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:31.546934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff296c-5830-4f39-b57c-b2b8bec23c7c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:31.547336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d12335-4712-44d2-a6be-d2eafb4f46d7 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:31.554016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-18ff296c-5830-4f39-b57c-b2b8bec23c7c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:19:31.554016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:31.554016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:19:31.554016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:19:31.554016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:19:31.554016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:19:31.554016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:19:31.554016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:31.554016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:19:31.554016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:31.554016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:31.554016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:31.554016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:31.554016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:31.554016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:31.554016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:31.554016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:31.555765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:31.555765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:31.555765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:31.555765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:31.555765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:31.555765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:31.555765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:19:31.555765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:19:31.555765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:19:31.555765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:19:31.555765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:31.555765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:31.555765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:31.555765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:31.555765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:31.555765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:31.556855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:31.556855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:31.556855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:31.556855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:31.556855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:31.556855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:31.556855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:31.556855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:31.556855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:31.556855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:31.556855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:19:31.556855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:31.556855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:19:31.556855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:31.556855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 496/996] 10.222.0.25 () {56 vars in 1105 bytes} [Sat Sep 24 19:19:31 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:31.557721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533325-59b1-441e-a849-ad0305ad4bae None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:31.557721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533325-59b1-441e-a849-ad0305ad4bae None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:31.557721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533325-59b1-441e-a849-ad0305ad4bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:31.575487 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-2b533325-59b1-441e-a849-ad0305ad4bae None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:31.576554 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2b533325-59b1-441e-a849-ad0305ad4bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:31.642258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:31.643241 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 497/997] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:31.648233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b533325-59b1-441e-a849-ad0305ad4bae None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:31.654251 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d12335-4712-44d2-a6be-d2eafb4f46d7 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:31.689099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c683bbc-d292-4a05-b013-d3dc04627093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:31.689704 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c683bbc-d292-4a05-b013-d3dc04627093 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:31.689982 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c683bbc-d292-4a05-b013-d3dc04627093 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:31.690250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c683bbc-d292-4a05-b013-d3dc04627093 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:31.690888 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c683bbc-d292-4a05-b013-d3dc04627093 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:31.691190 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c683bbc-d292-4a05-b013-d3dc04627093 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:31.692549 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c683bbc-d292-4a05-b013-d3dc04627093 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:31.702758 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 501/998] 10.222.0.25 () {56 vars in 1122 bytes} [Sat Sep 24 19:19:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:31.703745 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c683bbc-d292-4a05-b013-d3dc04627093 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:31.746748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:31.767849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b533325-59b1-441e-a849-ad0305ad4bae None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:31.803506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd728fd-5ee4-4de0-b42d-33dcefbed703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:31.804234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd728fd-5ee4-4de0-b42d-33dcefbed703 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:31.804512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd728fd-5ee4-4de0-b42d-33dcefbed703 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:31.804976 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd728fd-5ee4-4de0-b42d-33dcefbed703 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:31.805736 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd728fd-5ee4-4de0-b42d-33dcefbed703 None admin] RBAC: Adding query filter params (name=image) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:31.805837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c683bbc-d292-4a05-b013-d3dc04627093 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:31.806037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd728fd-5ee4-4de0-b42d-33dcefbed703 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:31.807443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd728fd-5ee4-4de0-b42d-33dcefbed703 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:31.812362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 498/999] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:31.817573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd728fd-5ee4-4de0-b42d-33dcefbed703 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:31.842588 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2c45b-91cc-40bc-8d1d-d81a9f5afd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:31.843224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2c45b-91cc-40bc-8d1d-d81a9f5afd24 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:31.843502 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2c45b-91cc-40bc-8d1d-d81a9f5afd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:31.843771 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2c45b-91cc-40bc-8d1d-d81a9f5afd24 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:31.844504 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2c45b-91cc-40bc-8d1d-d81a9f5afd24 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:31.844923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2c45b-91cc-40bc-8d1d-d81a9f5afd24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:31.846276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2c45b-91cc-40bc-8d1d-d81a9f5afd24 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:31.852123 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 502/1000] 10.222.0.25 () {56 vars in 1122 bytes} [Sat Sep 24 19:19:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:31.857622 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2c45b-91cc-40bc-8d1d-d81a9f5afd24 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:31.876171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:31.921344 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd728fd-5ee4-4de0-b42d-33dcefbed703 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:31.956204 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042f6e6-d3cc-456d-933b-3e0a53ce3132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:31.956807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042f6e6-d3cc-456d-933b-3e0a53ce3132 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:31.957084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042f6e6-d3cc-456d-933b-3e0a53ce3132 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:31.957359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042f6e6-d3cc-456d-933b-3e0a53ce3132 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:31.957976 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042f6e6-d3cc-456d-933b-3e0a53ce3132 None admin] RBAC: Adding query filter params (type=image) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:31.958274 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042f6e6-d3cc-456d-933b-3e0a53ce3132 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:31.959668 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042f6e6-d3cc-456d-933b-3e0a53ce3132 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:31.962652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2c45b-91cc-40bc-8d1d-d81a9f5afd24 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:31.964571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 499/1001] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:31.965344 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042f6e6-d3cc-456d-933b-3e0a53ce3132 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:31.987907 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:32.001918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070beb4-006e-41bd-a0fb-7e0c9ef83ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:32.002562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070beb4-006e-41bd-a0fb-7e0c9ef83ca1 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:32.002816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070beb4-006e-41bd-a0fb-7e0c9ef83ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:32.003127 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070beb4-006e-41bd-a0fb-7e0c9ef83ca1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:32.003813 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070beb4-006e-41bd-a0fb-7e0c9ef83ca1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:32.005217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070beb4-006e-41bd-a0fb-7e0c9ef83ca1 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:32.034860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 503/1002] 10.222.0.25 () {60 vars in 1144 bytes} [Sat Sep 24 19:19:31 2022] POST /identity/v3/endpoints => generated 325 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:19:32.101367 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042f6e6-d3cc-456d-933b-3e0a53ce3132 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:32.150523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5eea3e-0cc9-4508-ad53-42c9aed63c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:32.151203 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5eea3e-0cc9-4508-ad53-42c9aed63c40 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:32.151511 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5eea3e-0cc9-4508-ad53-42c9aed63c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:32.151781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5eea3e-0cc9-4508-ad53-42c9aed63c40 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:32.152368 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5eea3e-0cc9-4508-ad53-42c9aed63c40 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:32.153837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5eea3e-0cc9-4508-ad53-42c9aed63c40 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:32.164677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-bc5eea3e-0cc9-4508-ad53-42c9aed63c40 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:19:32.164677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:32.164677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:19:32.164677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:19:32.164677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:19:32.164677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:19:32.164677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:19:32.164677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:32.164677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:19:32.164677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:32.164677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:32.164677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:32.164677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:32.164677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:32.164677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:32.164677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:32.164677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:32.165762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:32.165762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:32.165762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:32.165762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:32.165762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:32.165762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:32.165762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:19:32.165762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:19:32.165762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:19:32.165762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:19:32.165762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:32.165762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:32.165762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:32.165762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:32.165762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:32.165762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:32.167247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:32.167247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:32.167247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:32.167247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:32.167247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:32.167247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:32.167247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:32.167247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:32.167247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:32.167247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:32.167247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:19:32.167247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:32.167247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:19:32.167247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:32.167247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 500/1003] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:19:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:32.172243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070beb4-006e-41bd-a0fb-7e0c9ef83ca1 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:32.259912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:32.284231 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070beb4-006e-41bd-a0fb-7e0c9ef83ca1 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:32.323242 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3d35b-f4db-416b-bb99-83c787f39c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:32.323863 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3d35b-f4db-416b-bb99-83c787f39c76 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:32.324142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3d35b-f4db-416b-bb99-83c787f39c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:32.324415 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3d35b-f4db-416b-bb99-83c787f39c76 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:32.325043 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3d35b-f4db-416b-bb99-83c787f39c76 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:32.325346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3d35b-f4db-416b-bb99-83c787f39c76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:32.326719 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3d35b-f4db-416b-bb99-83c787f39c76 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:32.332608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 504/1004] 10.222.0.25 () {56 vars in 1112 bytes} [Sat Sep 24 19:19:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:32.338406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5eea3e-0cc9-4508-ad53-42c9aed63c40 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:32.418145 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:32.456346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5eea3e-0cc9-4508-ad53-42c9aed63c40 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:32.495255 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d8dde-5d46-4f46-9fbe-875c80311f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:32.495870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d8dde-5d46-4f46-9fbe-875c80311f15 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:32.496153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d8dde-5d46-4f46-9fbe-875c80311f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:32.496429 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d8dde-5d46-4f46-9fbe-875c80311f15 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:32.497059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d8dde-5d46-4f46-9fbe-875c80311f15 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:32.497359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d8dde-5d46-4f46-9fbe-875c80311f15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:32.498715 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d8dde-5d46-4f46-9fbe-875c80311f15 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:32.504126 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 501/1005] 10.222.0.25 () {56 vars in 1112 bytes} [Sat Sep 24 19:19:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:32.510083 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3d35b-f4db-416b-bb99-83c787f39c76 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:32.614874 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3d35b-f4db-416b-bb99-83c787f39c76 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:32.649846 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a5e85-5c9b-46f3-b615-e4ac348a345b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:32.650457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a5e85-5c9b-46f3-b615-e4ac348a345b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:32.650739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a5e85-5c9b-46f3-b615-e4ac348a345b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:32.651042 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a5e85-5c9b-46f3-b615-e4ac348a345b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:32.651737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a5e85-5c9b-46f3-b615-e4ac348a345b None admin] RBAC: Adding query filter params (interface=public, service_id=6a8d67fd9a1b4462a9610328fac3f260, region_id=RegionOne) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:32.652045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a5e85-5c9b-46f3-b615-e4ac348a345b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:32.653409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a5e85-5c9b-46f3-b615-e4ac348a345b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:32.659136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 505/1006] 10.222.0.25 () {56 vars in 1251 bytes} [Sat Sep 24 19:19:32 2022] GET /identity/v3/endpoints?service_id=6a8d67fd9a1b4462a9610328fac3f260&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:32.672309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d8dde-5d46-4f46-9fbe-875c80311f15 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:32.785282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d8dde-5d46-4f46-9fbe-875c80311f15 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:32.820126 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad9efe-41bc-44fd-a295-e0fbe933c574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:32.821292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad9efe-41bc-44fd-a295-e0fbe933c574 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:32.821572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad9efe-41bc-44fd-a295-e0fbe933c574 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:32.821842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad9efe-41bc-44fd-a295-e0fbe933c574 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:32.822441 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad9efe-41bc-44fd-a295-e0fbe933c574 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:32.823831 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad9efe-41bc-44fd-a295-e0fbe933c574 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:32.824867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:32.831514 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 502/1007] 10.222.0.25 () {56 vars in 1087 bytes} [Sat Sep 24 19:19:32 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:19:34.189461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20528e2-b913-45fe-a943-10211042cc8b None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:34.190016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20528e2-b913-45fe-a943-10211042cc8b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:34.190016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20528e2-b913-45fe-a943-10211042cc8b None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:34.191407 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 506/1008] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:34.197227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c00b7-1357-40eb-ab2d-689a37d13859 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:34.197625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c00b7-1357-40eb-ab2d-689a37d13859 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:34.197804 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c00b7-1357-40eb-ab2d-689a37d13859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:34.216313 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-1a7c00b7-1357-40eb-ab2d-689a37d13859 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:34.217510 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1a7c00b7-1357-40eb-ab2d-689a37d13859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:34.254821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0add08-fa1b-4b74-801b-d7c8038f20fd None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:34.255121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0add08-fa1b-4b74-801b-d7c8038f20fd None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:34.255606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0add08-fa1b-4b74-801b-d7c8038f20fd None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:34.256910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 507/1009] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:19:34.262301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15604a2-1a3f-431c-b676-a4db606f2731 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:34.262589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15604a2-1a3f-431c-b676-a4db606f2731 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:34.262888 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15604a2-1a3f-431c-b676-a4db606f2731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:34.277368 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:34.282935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-f15604a2-1a3f-431c-b676-a4db606f2731 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:34.284204 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f15604a2-1a3f-431c-b676-a4db606f2731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:34.289724 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 503/1010] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:34 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:34.353723 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 508/1011] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:34 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:19:34.557192 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c00b7-1357-40eb-ab2d-689a37d13859 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:34.628554 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15604a2-1a3f-431c-b676-a4db606f2731 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:34.660493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c00b7-1357-40eb-ab2d-689a37d13859 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:34.689357 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:34.698271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ecfec-0a7d-4fb5-addb-f08acdc3ecc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:34.698909 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ecfec-0a7d-4fb5-addb-f08acdc3ecc8 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:34.699192 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ecfec-0a7d-4fb5-addb-f08acdc3ecc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:34.699468 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ecfec-0a7d-4fb5-addb-f08acdc3ecc8 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:34.700117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ecfec-0a7d-4fb5-addb-f08acdc3ecc8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:34.701487 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ecfec-0a7d-4fb5-addb-f08acdc3ecc8 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:34.718282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 504/1012] 10.222.0.25 () {60 vars in 1141 bytes} [Sat Sep 24 19:19:34 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:19:34.735672 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15604a2-1a3f-431c-b676-a4db606f2731 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:34.775498 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:34.782653 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638cbc3-3a0d-4fcb-ac36-07ea492ade57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:34.783333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638cbc3-3a0d-4fcb-ac36-07ea492ade57 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:34.783660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638cbc3-3a0d-4fcb-ac36-07ea492ade57 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:34.783884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638cbc3-3a0d-4fcb-ac36-07ea492ade57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:34.785054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638cbc3-3a0d-4fcb-ac36-07ea492ade57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:34.786550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638cbc3-3a0d-4fcb-ac36-07ea492ade57 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:34.793586 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 509/1013] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:34.794850 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ecfec-0a7d-4fb5-addb-f08acdc3ecc8 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:34.908091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ecfec-0a7d-4fb5-addb-f08acdc3ecc8 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:34.946190 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3188d-9eaf-492e-b256-a73493df0341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:34.946804 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3188d-9eaf-492e-b256-a73493df0341 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:34.947110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3188d-9eaf-492e-b256-a73493df0341 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:34.947379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3188d-9eaf-492e-b256-a73493df0341 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:34.948023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3188d-9eaf-492e-b256-a73493df0341 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:34.949445 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3188d-9eaf-492e-b256-a73493df0341 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:34.978433 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 505/1014] 10.222.0.25 () {60 vars in 1141 bytes} [Sat Sep 24 19:19:34 2022] POST /identity/v3/projects => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:19:35.025963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902427e9-cf27-4167-9f0c-3309fe87c68f None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:35.026302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902427e9-cf27-4167-9f0c-3309fe87c68f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:35.026503 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902427e9-cf27-4167-9f0c-3309fe87c68f None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:35.027883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 510/1015] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:35.033779 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca01e3-4c99-4446-a9b7-76db7b333836 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:35.034066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca01e3-4c99-4446-a9b7-76db7b333836 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:35.034338 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca01e3-4c99-4446-a9b7-76db7b333836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:35.054218 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-60ca01e3-4c99-4446-a9b7-76db7b333836 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:35.055690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-60ca01e3-4c99-4446-a9b7-76db7b333836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:35.096420 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:35.137924 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 506/1016] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:35 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:35.411736 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902427e9-cf27-4167-9f0c-3309fe87c68f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:35.529031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902427e9-cf27-4167-9f0c-3309fe87c68f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:35.564872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97326138-4b9b-4702-9286-fbecbeb13631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:35.565831 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97326138-4b9b-4702-9286-fbecbeb13631 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:35.566310 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97326138-4b9b-4702-9286-fbecbeb13631 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:35.566798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97326138-4b9b-4702-9286-fbecbeb13631 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:35.567610 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97326138-4b9b-4702-9286-fbecbeb13631 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:35.569237 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97326138-4b9b-4702-9286-fbecbeb13631 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:35.578264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-97326138-4b9b-4702-9286-fbecbeb13631 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:19:35.578264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:35.578264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:19:35.578264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:19:35.578264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:19:35.578264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:19:35.578264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:19:35.578264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:35.578264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:19:35.578264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:35.578264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:35.578264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:35.578264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:35.578264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:35.578264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:35.578264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:35.578264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:35.579306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:35.579306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:35.579306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:35.579306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:35.579306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:35.579306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:35.579306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:19:35.579306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:19:35.579306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:19:35.579306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:19:35.579306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:35.579306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:35.579306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:35.579306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:35.579306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:35.579306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:35.580162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:35.580162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:35.580162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:35.580162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:35.580162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:35.580162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:35.580162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:35.580162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:35.580162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:35.580162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:35.580162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:19:35.580162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:35.580162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:19:35.580162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:35.582870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 511/1017] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:19:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:35.587445 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca01e3-4c99-4446-a9b7-76db7b333836 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:35.694510 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca01e3-4c99-4446-a9b7-76db7b333836 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:35.730705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e5410-d7dd-4de3-b454-7cb351e35bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:35.731417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e5410-d7dd-4de3-b454-7cb351e35bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:35.731699 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e5410-d7dd-4de3-b454-7cb351e35bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:35.731972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e5410-d7dd-4de3-b454-7cb351e35bc6 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:35.732595 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e5410-d7dd-4de3-b454-7cb351e35bc6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:35.732896 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e5410-d7dd-4de3-b454-7cb351e35bc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:35.734248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e5410-d7dd-4de3-b454-7cb351e35bc6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:35.744223 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 507/1018] 10.222.0.25 () {56 vars in 1112 bytes} [Sat Sep 24 19:19:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:35.745751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97326138-4b9b-4702-9286-fbecbeb13631 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:35.811254 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:35.851086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97326138-4b9b-4702-9286-fbecbeb13631 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:35.887420 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6554fe-4f16-49d3-81d7-a5213033d765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:35.888071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6554fe-4f16-49d3-81d7-a5213033d765 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:35.888351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6554fe-4f16-49d3-81d7-a5213033d765 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:35.888619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6554fe-4f16-49d3-81d7-a5213033d765 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:35.889230 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6554fe-4f16-49d3-81d7-a5213033d765 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:35.889530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6554fe-4f16-49d3-81d7-a5213033d765 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:35.890975 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6554fe-4f16-49d3-81d7-a5213033d765 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:35.901292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 512/1019] 10.222.0.25 () {56 vars in 1112 bytes} [Sat Sep 24 19:19:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:35.902557 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e5410-d7dd-4de3-b454-7cb351e35bc6 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:35.940933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:36.015138 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e5410-d7dd-4de3-b454-7cb351e35bc6 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:36.050330 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeaf00b-89b9-45b2-a8a8-5d6ffd8515cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:36.051274 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaf00b-89b9-45b2-a8a8-5d6ffd8515cf None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:36.051755 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaf00b-89b9-45b2-a8a8-5d6ffd8515cf None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:36.052225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeaf00b-89b9-45b2-a8a8-5d6ffd8515cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:36.053097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeaf00b-89b9-45b2-a8a8-5d6ffd8515cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:36.054682 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeaf00b-89b9-45b2-a8a8-5d6ffd8515cf None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:36.075221 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 508/1020] 10.222.0.25 () {60 vars in 1144 bytes} [Sat Sep 24 19:19:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:19:36.910187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1543c0-c09c-4c1c-b08b-2990603155f0 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:36.910712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1543c0-c09c-4c1c-b08b-2990603155f0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:36.910712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1543c0-c09c-4c1c-b08b-2990603155f0 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:36.912122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 513/1021] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:36.917750 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e1d4b-e145-4dfb-92de-41464251eee9 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:36.918146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e1d4b-e145-4dfb-92de-41464251eee9 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:36.918309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e1d4b-e145-4dfb-92de-41464251eee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:36.936341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-cf2e1d4b-e145-4dfb-92de-41464251eee9 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:36.937526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-cf2e1d4b-e145-4dfb-92de-41464251eee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:37.012226 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 509/1022] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:37.211890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303142a3-863a-4825-af20-c5f2eeb5a99f None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:37.212107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303142a3-863a-4825-af20-c5f2eeb5a99f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:37.212326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303142a3-863a-4825-af20-c5f2eeb5a99f None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:37.213708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 514/1023] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:37.218771 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14e21f-2ad5-4da5-89db-070610170c79 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:37.219097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14e21f-2ad5-4da5-89db-070610170c79 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:37.219376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14e21f-2ad5-4da5-89db-070610170c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:37.237719 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-cd14e21f-2ad5-4da5-89db-070610170c79 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:37.238930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-cd14e21f-2ad5-4da5-89db-070610170c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:37.250226 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:37.287511 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303142a3-863a-4825-af20-c5f2eeb5a99f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:37.312817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 510/1024] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:37.395294 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303142a3-863a-4825-af20-c5f2eeb5a99f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:37.424094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:37.433570 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc41dfc-bd2c-412d-bd8d-262426717392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:37.434196 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc41dfc-bd2c-412d-bd8d-262426717392 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:37.434472 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc41dfc-bd2c-412d-bd8d-262426717392 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:37.434742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc41dfc-bd2c-412d-bd8d-262426717392 None admin] PATH_INFO: `/v3/services/image` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:37.435339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc41dfc-bd2c-412d-bd8d-262426717392 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:37.436703 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc41dfc-bd2c-412d-bd8d-262426717392 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:37.446427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-bfc41dfc-bd2c-412d-bd8d-262426717392 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:19:37.446427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:37.446427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:19:37.446427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:19:37.446427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:19:37.446427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:19:37.446427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:19:37.446427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:37.446427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:19:37.446427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:37.446427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:37.446427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:37.446427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:37.446427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:37.446427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:37.446427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:37.446427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:37.447618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:37.447618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:37.447618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:37.447618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:37.447618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:37.447618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:37.447618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:19:37.447618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:19:37.447618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:19:37.447618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:19:37.447618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:37.447618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:37.447618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:37.447618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:37.447618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:37.447618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:37.448461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:37.448461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:37.448461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:37.448461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:37.448461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:37.448461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:37.448461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:37.448461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:37.448461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:37.448461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:37.448461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:19:37.448461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:37.448461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:19:37.448461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:37.448461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 515/1025] 10.222.0.25 () {56 vars in 1105 bytes} [Sat Sep 24 19:19:37 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:37.453397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14e21f-2ad5-4da5-89db-070610170c79 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:37.563889 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14e21f-2ad5-4da5-89db-070610170c79 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:37.596344 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc41dfc-bd2c-412d-bd8d-262426717392 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:37.598525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030f711-02f1-4048-8860-f77cff27a56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:37.599169 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030f711-02f1-4048-8860-f77cff27a56a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:37.599446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030f711-02f1-4048-8860-f77cff27a56a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:37.599716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030f711-02f1-4048-8860-f77cff27a56a None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:37.600343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030f711-02f1-4048-8860-f77cff27a56a None admin] RBAC: Adding query filter params (name=image) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:37.600643 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030f711-02f1-4048-8860-f77cff27a56a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:37.602564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030f711-02f1-4048-8860-f77cff27a56a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:37.607618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 511/1026] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:37.613349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030f711-02f1-4048-8860-f77cff27a56a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:37.626567 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:37.710591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc41dfc-bd2c-412d-bd8d-262426717392 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:37.720068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030f711-02f1-4048-8860-f77cff27a56a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:37.744250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b12ee-d2e8-4133-b294-e0656e41f1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:37.744898 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b12ee-d2e8-4133-b294-e0656e41f1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:37.745153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b12ee-d2e8-4133-b294-e0656e41f1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:37.745422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b12ee-d2e8-4133-b294-e0656e41f1e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:37.746520 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b12ee-d2e8-4133-b294-e0656e41f1e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:37.747987 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b12ee-d2e8-4133-b294-e0656e41f1e6 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:37.749540 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 516/1027] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:37.755027 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b12ee-d2e8-4133-b294-e0656e41f1e6 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:37.758932 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d6528-a4fd-4d93-b4c7-0195e6d2d31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:37.759838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d6528-a4fd-4d93-b4c7-0195e6d2d31a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:37.760123 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d6528-a4fd-4d93-b4c7-0195e6d2d31a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:37.760400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d6528-a4fd-4d93-b4c7-0195e6d2d31a None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:37.761029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d6528-a4fd-4d93-b4c7-0195e6d2d31a None admin] RBAC: Adding query filter params (type=image) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:37.761333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d6528-a4fd-4d93-b4c7-0195e6d2d31a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:37.762688 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d6528-a4fd-4d93-b4c7-0195e6d2d31a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:37.772458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 512/1028] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:37.773768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d6528-a4fd-4d93-b4c7-0195e6d2d31a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:37.827241 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:37.855538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:37.873515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b12ee-d2e8-4133-b294-e0656e41f1e6 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:37.881491 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d6528-a4fd-4d93-b4c7-0195e6d2d31a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:37.911099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db49b4-72bc-4a72-8d55-9325422abd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:37.912486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db49b4-72bc-4a72-8d55-9325422abd8e None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:37.912980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db49b4-72bc-4a72-8d55-9325422abd8e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:37.913431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db49b4-72bc-4a72-8d55-9325422abd8e None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:37.915000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db49b4-72bc-4a72-8d55-9325422abd8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:37.916804 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db49b4-72bc-4a72-8d55-9325422abd8e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:37.917369 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa6f04-67fe-4f78-8899-3810b1cc0e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:37.917986 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa6f04-67fe-4f78-8899-3810b1cc0e5a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:37.918491 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa6f04-67fe-4f78-8899-3810b1cc0e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:37.918491 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa6f04-67fe-4f78-8899-3810b1cc0e5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:37.919243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa6f04-67fe-4f78-8899-3810b1cc0e5a None admin] RBAC: Adding query filter params (interface=public, service_id=e0e98ef90ee54e0180baa6da5cdc292d, region_id=RegionOne) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:37.919552 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa6f04-67fe-4f78-8899-3810b1cc0e5a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:37.920898 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa6f04-67fe-4f78-8899-3810b1cc0e5a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:37.926062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 513/1029] 10.222.0.25 () {56 vars in 1251 bytes} [Sat Sep 24 19:19:37 2022] GET /identity/v3/endpoints?service_id=e0e98ef90ee54e0180baa6da5cdc292d&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:37.931816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa6f04-67fe-4f78-8899-3810b1cc0e5a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:37.946389 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 517/1030] 10.222.0.25 () {60 vars in 1132 bytes} [Sat Sep 24 19:19:37 2022] POST /identity/v3/users => generated 285 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:19:38.056485 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa6f04-67fe-4f78-8899-3810b1cc0e5a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:38.094718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cc4ed-dd53-450b-aae6-18068c2593bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:38.095394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cc4ed-dd53-450b-aae6-18068c2593bf None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:38.095673 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cc4ed-dd53-450b-aae6-18068c2593bf None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:38.095943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cc4ed-dd53-450b-aae6-18068c2593bf None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:38.096607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cc4ed-dd53-450b-aae6-18068c2593bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:38.097996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cc4ed-dd53-450b-aae6-18068c2593bf None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:38.110869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 514/1031] 10.222.0.25 () {56 vars in 1087 bytes} [Sat Sep 24 19:19:37 2022] GET /identity/v3/services => generated 1957 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:19:38.360051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655528d8-8237-4e41-b326-ba214fd9d739 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:38.360399 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655528d8-8237-4e41-b326-ba214fd9d739 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:38.360505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655528d8-8237-4e41-b326-ba214fd9d739 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:38.361973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 518/1032] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:38.367523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286bbe7-d14f-4833-8723-225c26bc4eae None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:38.367888 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286bbe7-d14f-4833-8723-225c26bc4eae None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:38.368165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286bbe7-d14f-4833-8723-225c26bc4eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:38.374593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:38.387943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-4286bbe7-d14f-4833-8723-225c26bc4eae None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:38.389177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4286bbe7-d14f-4833-8723-225c26bc4eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:38.465872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 515/1033] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:38.737356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655528d8-8237-4e41-b326-ba214fd9d739 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:38.840719 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655528d8-8237-4e41-b326-ba214fd9d739 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:38.857157 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:38.877198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5f1f0-c4d5-4a19-be60-059dd3cba44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:38.877850 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5f1f0-c4d5-4a19-be60-059dd3cba44e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:38.878128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5f1f0-c4d5-4a19-be60-059dd3cba44e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:38.878394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5f1f0-c4d5-4a19-be60-059dd3cba44e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:38.889312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5f1f0-c4d5-4a19-be60-059dd3cba44e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:19:38.894056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-17d5f1f0-c4d5-4a19-be60-059dd3cba44e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:19:38.894056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:38.894056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:38.894056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:38.894056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:38.894056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:38.894056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:38.894056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:38.894056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:38.894056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:38.894056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:38.894056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:38.894056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:19:38.894056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:19:38.894056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:19:38.894056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:19:38.895066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:19:38.895066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:19:38.895066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:19:38.895066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:19:38.895066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:38.895066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:38.895066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:38.895066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:38.895066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:38.895066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:38.895066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:38.895066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:38.895066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:38.895066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:38.895066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:38.895066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:38.896526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:38.896526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:38.896526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:38.896526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:38.896526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:19:38.896526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:19:38.896526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:19:38.896526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:19:38.896526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:19:38.896526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:19:38.896526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:19:38.896526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:38.896526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 519/1034] 10.222.0.25 () {56 vars in 1120 bytes} [Sat Sep 24 19:19:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:38.901892 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286bbe7-d14f-4833-8723-225c26bc4eae None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:39.002199 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286bbe7-d14f-4833-8723-225c26bc4eae None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:39.033917 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:39.040192 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887449f-af0b-47f8-b31e-64f855c8bc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:39.040804 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887449f-af0b-47f8-b31e-64f855c8bc92 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:39.041080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887449f-af0b-47f8-b31e-64f855c8bc92 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:39.041351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887449f-af0b-47f8-b31e-64f855c8bc92 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:39.042013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887449f-af0b-47f8-b31e-64f855c8bc92 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:39.042312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887449f-af0b-47f8-b31e-64f855c8bc92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:39.043698 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887449f-af0b-47f8-b31e-64f855c8bc92 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:39.057096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 516/1035] 10.222.0.25 () {56 vars in 1115 bytes} [Sat Sep 24 19:19:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:39.058544 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5f1f0-c4d5-4a19-be60-059dd3cba44e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:39.158463 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5f1f0-c4d5-4a19-be60-059dd3cba44e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:39.192591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c1b8c-8d83-4454-94db-e27ff53c9cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:39.193205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c1b8c-8d83-4454-94db-e27ff53c9cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:39.193483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c1b8c-8d83-4454-94db-e27ff53c9cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:39.193751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c1b8c-8d83-4454-94db-e27ff53c9cf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:39.203791 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c1b8c-8d83-4454-94db-e27ff53c9cf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:39.205226 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c1b8c-8d83-4454-94db-e27ff53c9cf8 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:39.219516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-ce2c1b8c-8d83-4454-94db-e27ff53c9cf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:39.219516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:39.219516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:39.219516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:39.219516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:39.219516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:39.219516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:39.219516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:39.219516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:39.219516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:39.219516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:39.219516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:39.219516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:39.219516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:39.219516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:39.219516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:39.220476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:39.220476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:39.220476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:39.220476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:39.220476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:39.220476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:39.220476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:39.220476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:39.220476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:39.220476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:39.220476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:39.220476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:39.220476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:39.220476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:39.220476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:39.220476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:39.220476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:39.221773 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:39.221773 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:39.221773 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:39.221773 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 520/1036] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:39.226885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887449f-af0b-47f8-b31e-64f855c8bc92 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:39.332689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887449f-af0b-47f8-b31e-64f855c8bc92 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:39.367064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83eae6-c719-417e-ba6e-4206b393bc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:39.367816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83eae6-c719-417e-ba6e-4206b393bc90 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:39.368097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83eae6-c719-417e-ba6e-4206b393bc90 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:39.368371 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83eae6-c719-417e-ba6e-4206b393bc90 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:39.369014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83eae6-c719-417e-ba6e-4206b393bc90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:39.369319 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83eae6-c719-417e-ba6e-4206b393bc90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:39.370683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83eae6-c719-417e-ba6e-4206b393bc90 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:39.387719 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 517/1037] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:39.389260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c1b8c-8d83-4454-94db-e27ff53c9cf8 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:39.423911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:39.499766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c1b8c-8d83-4454-94db-e27ff53c9cf8 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:39.533188 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586b6b9-3f5d-4552-8cea-876ba461e7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:39.533808 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586b6b9-3f5d-4552-8cea-876ba461e7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:39.534086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586b6b9-3f5d-4552-8cea-876ba461e7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:39.534352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586b6b9-3f5d-4552-8cea-876ba461e7f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:39.541688 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586b6b9-3f5d-4552-8cea-876ba461e7f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:39.543146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586b6b9-3f5d-4552-8cea-876ba461e7f8 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:39.553902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-1586b6b9-3f5d-4552-8cea-876ba461e7f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:19:39.553902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:39.553902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:39.553902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:39.553902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:39.553902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:39.553902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:39.553902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:39.553902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:39.553902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:39.553902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:39.553902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:39.553902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:19:39.553902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:19:39.553902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:19:39.553902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:19:39.555573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:39.555573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:39.555573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:19:39.555573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:39.555573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:19:39.555573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:39.555573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:39.555573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:39.555573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:39.555573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:39.555573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:39.555573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:39.555573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:39.555573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:39.555573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:39.555573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:39.555573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:39.555573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:39.556529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:39.556529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:39.556529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:19:39.556529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:19:39.556529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:19:39.556529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:19:39.556529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:19:39.556529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:19:39.556529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:19:39.556529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:39.559167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 521/1038] 10.222.0.25 () {56 vars in 1093 bytes} [Sat Sep 24 19:19:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:39.561424 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83eae6-c719-417e-ba6e-4206b393bc90 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:39.620860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:39.670728 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83eae6-c719-417e-ba6e-4206b393bc90 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:39.705682 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642cdba-e9ad-421c-804f-fe15c7636176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:39.706290 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642cdba-e9ad-421c-804f-fe15c7636176 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:39.706566 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642cdba-e9ad-421c-804f-fe15c7636176 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:39.706847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642cdba-e9ad-421c-804f-fe15c7636176 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:39.707580 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642cdba-e9ad-421c-804f-fe15c7636176 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:39.707879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642cdba-e9ad-421c-804f-fe15c7636176 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:39.709285 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642cdba-e9ad-421c-804f-fe15c7636176 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:39.731737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 518/1039] 10.222.0.25 () {56 vars in 1133 bytes} [Sat Sep 24 19:19:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:39.733030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586b6b9-3f5d-4552-8cea-876ba461e7f8 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:39.825201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:39.838540 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586b6b9-3f5d-4552-8cea-876ba461e7f8 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:39.873583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a357929-762a-4f4e-8314-4f2f1f973aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:39.874096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a357929-762a-4f4e-8314-4f2f1f973aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:39.874374 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a357929-762a-4f4e-8314-4f2f1f973aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:39.874645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a357929-762a-4f4e-8314-4f2f1f973aa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:39.943125 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a357929-762a-4f4e-8314-4f2f1f973aa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:39.944579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a357929-762a-4f4e-8314-4f2f1f973aa5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:40.030003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:40.048803 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 522/1040] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:19:39 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:19:40.050602 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642cdba-e9ad-421c-804f-fe15c7636176 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:40.162487 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642cdba-e9ad-421c-804f-fe15c7636176 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:40.176919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:40.200672 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10af7a5-ce8e-47e7-91dd-2896b5a8a851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:40.201330 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10af7a5-ce8e-47e7-91dd-2896b5a8a851 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:40.201608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10af7a5-ce8e-47e7-91dd-2896b5a8a851 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:40.201882 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10af7a5-ce8e-47e7-91dd-2896b5a8a851 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:40.213949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10af7a5-ce8e-47e7-91dd-2896b5a8a851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:40.215470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10af7a5-ce8e-47e7-91dd-2896b5a8a851 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:40.218175 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b5c02-04f6-4c02-8f05-b95bb4d807ea None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:40.218676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b5c02-04f6-4c02-8f05-b95bb4d807ea None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:40.218764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b5c02-04f6-4c02-8f05-b95bb4d807ea None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:40.220282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 523/1041] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:40.226083 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376c139-9943-4896-b6d3-3a8cb4285a58 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:40.226935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376c139-9943-4896-b6d3-3a8cb4285a58 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:40.227205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376c139-9943-4896-b6d3-3a8cb4285a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:40.234152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-f10af7a5-ce8e-47e7-91dd-2896b5a8a851 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:40.234152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:40.234152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:40.234152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:40.234152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:40.234152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:40.234152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:40.234152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:40.234152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:40.234152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:40.234152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:40.234152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:40.234152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:40.234152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:40.234152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:40.234152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:40.235305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:40.235305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:40.235305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:40.235305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:40.235305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:40.235305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:40.235305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:40.235305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:40.235305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:40.235305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:40.235305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:40.235305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:40.235305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:40.235305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:40.235305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:40.235305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:40.235305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:40.236214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:40.236214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:40.236214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:40.236402 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 519/1042] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:40.242066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10af7a5-ce8e-47e7-91dd-2896b5a8a851 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:40.249762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-3376c139-9943-4896-b6d3-3a8cb4285a58 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:40.251016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-3376c139-9943-4896-b6d3-3a8cb4285a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:40.327162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 524/1043] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:19:40.331485 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b72b3b-99bf-480e-a0f4-b238f564c00e None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:40.331775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b72b3b-99bf-480e-a0f4-b238f564c00e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:40.332047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b72b3b-99bf-480e-a0f4-b238f564c00e None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:40.333445 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 525/1044] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:19:40.339464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6eda6-e354-4c14-a66d-32d3c9ba80a8 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:40.339753 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6eda6-e354-4c14-a66d-32d3c9ba80a8 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:40.340030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6eda6-e354-4c14-a66d-32d3c9ba80a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:40.354522 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10af7a5-ce8e-47e7-91dd-2896b5a8a851 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:40.359336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-c9a6eda6-e354-4c14-a66d-32d3c9ba80a8 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:40.360563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c9a6eda6-e354-4c14-a66d-32d3c9ba80a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:40.390292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b1396-39bd-4993-9835-10dd166227f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:40.390928 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b1396-39bd-4993-9835-10dd166227f0 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:40.391207 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b1396-39bd-4993-9835-10dd166227f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:40.391481 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b1396-39bd-4993-9835-10dd166227f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:40.392111 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b1396-39bd-4993-9835-10dd166227f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:40.392436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b1396-39bd-4993-9835-10dd166227f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:40.393782 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b1396-39bd-4993-9835-10dd166227f0 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:40.406886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 520/1045] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:40.412476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b1396-39bd-4993-9835-10dd166227f0 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:40.438855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 526/1046] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:40.440416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:40.518629 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b1396-39bd-4993-9835-10dd166227f0 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:40.555748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426dac6-9eb4-478f-97b2-5791b10dbdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:40.556371 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426dac6-9eb4-478f-97b2-5791b10dbdce None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:40.556651 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426dac6-9eb4-478f-97b2-5791b10dbdce None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:40.556966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426dac6-9eb4-478f-97b2-5791b10dbdce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:40.563742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426dac6-9eb4-478f-97b2-5791b10dbdce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:40.565229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426dac6-9eb4-478f-97b2-5791b10dbdce None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:40.576852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-a426dac6-9eb4-478f-97b2-5791b10dbdce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:40.576852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:40.576852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:40.576852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:40.576852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:40.576852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:40.576852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:40.576852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:40.576852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:40.576852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:40.576852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:40.576852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:40.576852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:19:40.576852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:19:40.576852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:19:40.577759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:19:40.577759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:40.577759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:40.577759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:40.577759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:40.577759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:40.577759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:40.577759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:40.577759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:40.577759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:40.577759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:40.577759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:40.577759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:40.577759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:40.577759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:40.577759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:40.577759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:40.578690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:19:40.578690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:19:40.578690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:19:40.578690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:19:40.578690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:19:40.578690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:19:40.578690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:40.578690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:40.579820 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 521/1047] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:19:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:40.583976 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6eda6-e354-4c14-a66d-32d3c9ba80a8 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:40.592897 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426dac6-9eb4-478f-97b2-5791b10dbdce None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:40.637639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:40.685456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:40.691947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6eda6-e354-4c14-a66d-32d3c9ba80a8 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:40.703780 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426dac6-9eb4-478f-97b2-5791b10dbdce None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:40.725606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8299c-f6a8-446a-8bb4-ca052f86d15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:40.726718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8299c-f6a8-446a-8bb4-ca052f86d15d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:40.727034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8299c-f6a8-446a-8bb4-ca052f86d15d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:40.727304 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8299c-f6a8-446a-8bb4-ca052f86d15d None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:40.727975 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8299c-f6a8-446a-8bb4-ca052f86d15d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:40.728282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8299c-f6a8-446a-8bb4-ca052f86d15d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:40.729694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8299c-f6a8-446a-8bb4-ca052f86d15d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:40.738593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b677a-a03b-4246-8b87-3b11619dc353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:40.739258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b677a-a03b-4246-8b87-3b11619dc353 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:40.739539 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b677a-a03b-4246-8b87-3b11619dc353 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:40.739813 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b677a-a03b-4246-8b87-3b11619dc353 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:40.740767 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 527/1048] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:19:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:40.741754 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8299c-f6a8-446a-8bb4-ca052f86d15d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:40.752411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b677a-a03b-4246-8b87-3b11619dc353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:19:40.758201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-783b677a-a03b-4246-8b87-3b11619dc353 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:19:40.758201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:40.758201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:40.758201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:40.758201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:40.758201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:40.758201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:40.758201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:40.758201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:40.758201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:40.758201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:40.758201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:40.758201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:19:40.758201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:19:40.758201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:19:40.758201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:19:40.759217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:19:40.759217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:19:40.759217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:19:40.759217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:19:40.759217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:40.759217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:40.759217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:40.759217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:40.759217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:40.759217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:40.759217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:40.759217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:40.759217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:40.759217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:40.759217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:40.759217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:40.760573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:40.760573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:40.760573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:40.760573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:40.760573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:19:40.760573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:19:40.760573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:19:40.760573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:19:40.760573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:19:40.760573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:19:40.760573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:19:40.760573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:40.760573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 522/1049] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:19:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:40.760573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b677a-a03b-4246-8b87-3b11619dc353 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:40.844521 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8299c-f6a8-446a-8bb4-ca052f86d15d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:40.853641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:40.861419 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b677a-a03b-4246-8b87-3b11619dc353 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:40.878934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777c148-3711-41f6-a26b-ff81ae64eb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:40.879554 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777c148-3711-41f6-a26b-ff81ae64eb39 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:40.879829 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777c148-3711-41f6-a26b-ff81ae64eb39 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:40.880100 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777c148-3711-41f6-a26b-ff81ae64eb39 None admin] PATH_INFO: `/v3/services/image` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:40.880667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777c148-3711-41f6-a26b-ff81ae64eb39 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:40.882025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777c148-3711-41f6-a26b-ff81ae64eb39 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:40.890600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-0777c148-3711-41f6-a26b-ff81ae64eb39 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:19:40.890600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:40.890600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:19:40.890600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:19:40.890600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:19:40.890600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:19:40.890600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:19:40.890600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:40.890600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:19:40.890600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:40.890600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:19:40.890600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:40.890600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:40.890600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:40.890600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:40.890600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:40.890600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:40.891676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:40.891676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:40.891676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:40.891676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:40.891676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:40.891676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:40.891676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:19:40.891676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:19:40.891676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:19:40.891676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:19:40.891676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:40.891676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:40.891676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:40.891676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:40.891676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:40.891676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:40.892532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:40.892532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:40.892532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:40.892532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:40.892532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:40.892532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:40.892532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:40.892532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:40.892532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:40.892532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:40.892532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:19:40.892532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:19:40.892532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:19:40.892532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:40.892532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 528/1050] 10.222.0.25 () {56 vars in 1105 bytes} [Sat Sep 24 19:19:40 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:40.893356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777c148-3711-41f6-a26b-ff81ae64eb39 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:40.898172 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9b3ce-459f-48e2-b7a3-5d2babfd0cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:40.898781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9b3ce-459f-48e2-b7a3-5d2babfd0cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:40.899337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9b3ce-459f-48e2-b7a3-5d2babfd0cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:40.899608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9b3ce-459f-48e2-b7a3-5d2babfd0cf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:40.900330 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9b3ce-459f-48e2-b7a3-5d2babfd0cf0 None admin] RBAC: Adding query filter params (role.id=c350cad9e8c64a188a5f0b2bafe29a40, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=4e5798be0fa544cf9cf48558e87fcfa9) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:40.900636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9b3ce-459f-48e2-b7a3-5d2babfd0cf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:40.902053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9b3ce-459f-48e2-b7a3-5d2babfd0cf0 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:40.907561 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 523/1051] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:19:40 2022] GET /identity/v3/role_assignments?user.id=4e5798be0fa544cf9cf48558e87fcfa9&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=c350cad9e8c64a188a5f0b2bafe29a40 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:40.908328 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9b3ce-459f-48e2-b7a3-5d2babfd0cf0 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:40.927575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:41.008109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777c148-3711-41f6-a26b-ff81ae64eb39 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:41.037464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9b3ce-459f-48e2-b7a3-5d2babfd0cf0 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:41.051296 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65de75-fcec-40c7-a948-bc22b10ff7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:41.051917 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65de75-fcec-40c7-a948-bc22b10ff7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:41.052201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65de75-fcec-40c7-a948-bc22b10ff7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:41.052475 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65de75-fcec-40c7-a948-bc22b10ff7f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:41.053146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65de75-fcec-40c7-a948-bc22b10ff7f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:41.053449 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65de75-fcec-40c7-a948-bc22b10ff7f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:41.055124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65de75-fcec-40c7-a948-bc22b10ff7f4 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:41.071328 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 529/1052] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:19:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:41.072391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65de75-fcec-40c7-a948-bc22b10ff7f4 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:41.075218 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a935766-f5a1-4a66-b272-262ad0679603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:41.075839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a935766-f5a1-4a66-b272-262ad0679603 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:41.076126 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a935766-f5a1-4a66-b272-262ad0679603 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:41.076396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a935766-f5a1-4a66-b272-262ad0679603 None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:41.077033 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a935766-f5a1-4a66-b272-262ad0679603 None admin] RBAC: Adding query filter params (name=image) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:41.077336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a935766-f5a1-4a66-b272-262ad0679603 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:41.078774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a935766-f5a1-4a66-b272-262ad0679603 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:41.084189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 524/1053] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:41.091212 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a935766-f5a1-4a66-b272-262ad0679603 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:41.116157 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:41.175632 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:41.189799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65de75-fcec-40c7-a948-bc22b10ff7f4 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:41.212165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a935766-f5a1-4a66-b272-262ad0679603 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:41.226973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad6ba1-af78-44d9-8916-d615e5cd1dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:41.227628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad6ba1-af78-44d9-8916-d615e5cd1dce None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:41.227951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad6ba1-af78-44d9-8916-d615e5cd1dce None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:41.228208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad6ba1-af78-44d9-8916-d615e5cd1dce None admin] PATH_INFO: `/v3/users/5a29a5ba0ee9435285f1087b99e9f26a` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:41.242483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad6ba1-af78-44d9-8916-d615e5cd1dce None admin] RBAC: Authorizing `identity:get_user(user_id=5a29a5ba0ee9435285f1087b99e9f26a)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:41.243965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad6ba1-af78-44d9-8916-d615e5cd1dce None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:41.250277 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 530/1054] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:19:41 2022] GET /identity/v3/users/5a29a5ba0ee9435285f1087b99e9f26a => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:41.251327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad6ba1-af78-44d9-8916-d615e5cd1dce None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:41.255929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da8f6e-02e2-42bf-87f8-063ff3c91b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:41.256549 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da8f6e-02e2-42bf-87f8-063ff3c91b4d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:41.256832 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da8f6e-02e2-42bf-87f8-063ff3c91b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:41.257114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da8f6e-02e2-42bf-87f8-063ff3c91b4d None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:41.257802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da8f6e-02e2-42bf-87f8-063ff3c91b4d None admin] RBAC: Adding query filter params (type=image) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:41.258107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da8f6e-02e2-42bf-87f8-063ff3c91b4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:41.259549 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da8f6e-02e2-42bf-87f8-063ff3c91b4d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:41.270465 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 525/1055] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:41.271482 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da8f6e-02e2-42bf-87f8-063ff3c91b4d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:41.350255 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:41.361838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad6ba1-af78-44d9-8916-d615e5cd1dce None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:41.377936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da8f6e-02e2-42bf-87f8-063ff3c91b4d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:41.401050 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505da11-a562-4132-b280-abd50e683d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:41.401662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505da11-a562-4132-b280-abd50e683d48 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:41.401941 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505da11-a562-4132-b280-abd50e683d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:41.402212 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505da11-a562-4132-b280-abd50e683d48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:41.424317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513922d-6578-41c8-b55c-97979d34212e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:41.424935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513922d-6578-41c8-b55c-97979d34212e None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:41.425217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513922d-6578-41c8-b55c-97979d34212e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:41.425492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513922d-6578-41c8-b55c-97979d34212e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:41.426165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513922d-6578-41c8-b55c-97979d34212e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:41.427560 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513922d-6578-41c8-b55c-97979d34212e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:41.433448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:41.451731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 526/1056] 10.222.0.25 () {60 vars in 1144 bytes} [Sat Sep 24 19:19:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:19:41.489844 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505da11-a562-4132-b280-abd50e683d48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:41.491356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505da11-a562-4132-b280-abd50e683d48 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:41.598885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:41.614385 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 531/1057] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:19:41 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 19:19:41.615794 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513922d-6578-41c8-b55c-97979d34212e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:41.730347 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513922d-6578-41c8-b55c-97979d34212e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:41.764718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabcb5b-2586-411f-a15f-2a6bad5c7ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:41.765359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabcb5b-2586-411f-a15f-2a6bad5c7ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:41.765652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabcb5b-2586-411f-a15f-2a6bad5c7ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:41.765918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabcb5b-2586-411f-a15f-2a6bad5c7ec6 None admin] PATH_INFO: `/v3/projects/6e008d51a04943ddb0ccb73921d5466e` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:41.767060 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabcb5b-2586-411f-a15f-2a6bad5c7ec6 None admin] RBAC: Authorizing `identity:get_project(project_id=6e008d51a04943ddb0ccb73921d5466e)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:41.768479 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabcb5b-2586-411f-a15f-2a6bad5c7ec6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:41.770257 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 527/1058] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:19:41 2022] GET /identity/v3/projects/6e008d51a04943ddb0ccb73921d5466e => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:41.777342 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505da11-a562-4132-b280-abd50e683d48 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:41.881233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505da11-a562-4132-b280-abd50e683d48 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:41.914742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40e169-0dcf-4e30-9f5e-af0cb19452c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:41.915348 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40e169-0dcf-4e30-9f5e-af0cb19452c9 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:41.915619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40e169-0dcf-4e30-9f5e-af0cb19452c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:41.915874 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40e169-0dcf-4e30-9f5e-af0cb19452c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:41.916574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40e169-0dcf-4e30-9f5e-af0cb19452c9 None admin] RBAC: Adding query filter params (role.id=dd27845a836a4f6ebece149dbebc59c0, scope.project.id=6e008d51a04943ddb0ccb73921d5466e, user.id=5a29a5ba0ee9435285f1087b99e9f26a) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:41.916875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40e169-0dcf-4e30-9f5e-af0cb19452c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:41.918270 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40e169-0dcf-4e30-9f5e-af0cb19452c9 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:41.923761 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 532/1059] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:19:41 2022] GET /identity/v3/role_assignments?user.id=5a29a5ba0ee9435285f1087b99e9f26a&scope.project.id=6e008d51a04943ddb0ccb73921d5466e&role.id=dd27845a836a4f6ebece149dbebc59c0 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:43.088025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146edec-92bf-48f9-b945-ba5ec8a008f0 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:43.088604 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146edec-92bf-48f9-b945-ba5ec8a008f0 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:43.088604 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146edec-92bf-48f9-b945-ba5ec8a008f0 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:43.089946 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 528/1060] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:43.095018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856e2db-8f02-42a2-a486-e869a80e98d1 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:43.095419 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856e2db-8f02-42a2-a486-e869a80e98d1 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:43.095587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856e2db-8f02-42a2-a486-e869a80e98d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:43.114177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-5856e2db-8f02-42a2-a486-e869a80e98d1 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:43.115384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5856e2db-8f02-42a2-a486-e869a80e98d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:43.166640 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:43.184440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 533/1061] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:43.451385 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146edec-92bf-48f9-b945-ba5ec8a008f0 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:43.511306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:43.563835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146edec-92bf-48f9-b945-ba5ec8a008f0 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:43.603303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f547b-4b71-48ec-906e-7792f2743885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:43.603938 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f547b-4b71-48ec-906e-7792f2743885 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:43.604215 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f547b-4b71-48ec-906e-7792f2743885 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:43.604483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f547b-4b71-48ec-906e-7792f2743885 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:43.616211 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f547b-4b71-48ec-906e-7792f2743885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:19:43.621689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-864f547b-4b71-48ec-906e-7792f2743885 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:19:43.621689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:43.621689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:43.621689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:43.621689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:43.621689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:43.621689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:43.621689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:43.621689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:43.621689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:43.621689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:43.621689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:43.621689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:19:43.621689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:19:43.621689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:19:43.621689 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:19:43.622693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:19:43.622693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:19:43.622693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:19:43.622693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:19:43.622693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:43.622693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:43.622693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:43.622693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:43.622693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:43.622693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:43.622693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:43.622693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:43.622693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:43.622693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:43.622693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:43.622693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:43.623664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:43.623664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:43.623664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:43.623664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:43.623664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:19:43.623664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:19:43.623664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:19:43.623664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:19:43.623664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:19:43.623664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:19:43.623664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:19:43.623664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:43.627139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 529/1062] 10.222.0.25 () {56 vars in 1120 bytes} [Sat Sep 24 19:19:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:43.628697 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856e2db-8f02-42a2-a486-e869a80e98d1 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:43.681673 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa0a50-c258-449d-94dd-2c23eafc9276 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:43.681850 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa0a50-c258-449d-94dd-2c23eafc9276 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:43.682122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa0a50-c258-449d-94dd-2c23eafc9276 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:43.684001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 530/1063] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:19:43.688899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dbeb0-3ef4-48b9-8c17-a678bcbb53d7 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:43.689183 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dbeb0-3ef4-48b9-8c17-a678bcbb53d7 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:43.689455 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dbeb0-3ef4-48b9-8c17-a678bcbb53d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:43.708155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-877dbeb0-3ef4-48b9-8c17-a678bcbb53d7 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:43.709330 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-877dbeb0-3ef4-48b9-8c17-a678bcbb53d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:43.732221 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856e2db-8f02-42a2-a486-e869a80e98d1 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:43.769214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42f87f-d47e-4d58-987e-9ea77c7f388e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:43.769812 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42f87f-d47e-4d58-987e-9ea77c7f388e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:43.770257 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42f87f-d47e-4d58-987e-9ea77c7f388e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:43.770439 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42f87f-d47e-4d58-987e-9ea77c7f388e None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:43.771230 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42f87f-d47e-4d58-987e-9ea77c7f388e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:43.771526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42f87f-d47e-4d58-987e-9ea77c7f388e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:43.772865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42f87f-d47e-4d58-987e-9ea77c7f388e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:43.778797 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 531/1064] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:19:43.786228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 534/1065] 10.222.0.25 () {56 vars in 1115 bytes} [Sat Sep 24 19:19:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:43.787261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877dbeb0-3ef4-48b9-8c17-a678bcbb53d7 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:43.836061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:43.889998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877dbeb0-3ef4-48b9-8c17-a678bcbb53d7 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:43.924322 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35573f43-6501-4c5c-9649-ee64a50e2e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:43.924954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35573f43-6501-4c5c-9649-ee64a50e2e1c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:43.925234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35573f43-6501-4c5c-9649-ee64a50e2e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:43.925505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35573f43-6501-4c5c-9649-ee64a50e2e1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:43.936184 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35573f43-6501-4c5c-9649-ee64a50e2e1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:43.937571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35573f43-6501-4c5c-9649-ee64a50e2e1c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:43.952259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-35573f43-6501-4c5c-9649-ee64a50e2e1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:43.952259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:43.952259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:43.952259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:43.952259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:43.952259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:43.952259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:43.952259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:43.952259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:43.952259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:43.952259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:43.952259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:43.952259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:43.952259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:43.952259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:43.952259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:43.953307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:43.953307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:43.953307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:43.953307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:43.953307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:43.953307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:43.953307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:43.953307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:43.953307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:43.953307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:43.953307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:43.953307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:43.953307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:43.953307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:43.953307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:43.953307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:43.953307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:43.959600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:43.959600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:43.959600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:43.959600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 532/1066] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:43.959862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42f87f-d47e-4d58-987e-9ea77c7f388e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:44.012500 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:44.048128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35573f43-6501-4c5c-9649-ee64a50e2e1c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:44.068338 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42f87f-d47e-4d58-987e-9ea77c7f388e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:44.108937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f8f09-36b3-4ef7-ace3-01434dc5a9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:44.109631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f8f09-36b3-4ef7-ace3-01434dc5a9b2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:44.109799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f8f09-36b3-4ef7-ace3-01434dc5a9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:44.110065 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f8f09-36b3-4ef7-ace3-01434dc5a9b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:44.110690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f8f09-36b3-4ef7-ace3-01434dc5a9b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:44.111024 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f8f09-36b3-4ef7-ace3-01434dc5a9b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:44.112386 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f8f09-36b3-4ef7-ace3-01434dc5a9b2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:44.123894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 535/1067] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:44.125058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52dcae-80be-4a9e-96ad-4f1273f051f5 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:44.125335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52dcae-80be-4a9e-96ad-4f1273f051f5 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:44.125603 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52dcae-80be-4a9e-96ad-4f1273f051f5 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:44.126772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 536/1068] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:44.131085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52dcae-80be-4a9e-96ad-4f1273f051f5 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:44.156230 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:44.160894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35573f43-6501-4c5c-9649-ee64a50e2e1c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:44.194472 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dbcfa-60ad-45c8-aa0a-025d8c806f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:44.195080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dbcfa-60ad-45c8-aa0a-025d8c806f59 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:44.195423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dbcfa-60ad-45c8-aa0a-025d8c806f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:44.195803 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dbcfa-60ad-45c8-aa0a-025d8c806f59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:44.232081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52dcae-80be-4a9e-96ad-4f1273f051f5 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:44.241019 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:44.261660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dbcfa-60ad-45c8-aa0a-025d8c806f59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:44.263133 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dbcfa-60ad-45c8-aa0a-025d8c806f59 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:44.266282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9995456-306f-4c1c-83a6-d5d79a4e52fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:44.267033 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9995456-306f-4c1c-83a6-d5d79a4e52fb None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:44.267415 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9995456-306f-4c1c-83a6-d5d79a4e52fb None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:44.267581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9995456-306f-4c1c-83a6-d5d79a4e52fb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:44.275603 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9995456-306f-4c1c-83a6-d5d79a4e52fb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:44.277035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9995456-306f-4c1c-83a6-d5d79a4e52fb None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:44.288340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-b9995456-306f-4c1c-83a6-d5d79a4e52fb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:19:44.288340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:44.288340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:44.288340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:44.288340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:44.288340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:44.288340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:44.288340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:44.288340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:44.288340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:44.288340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:44.288340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:44.288340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:19:44.288340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:19:44.288340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:19:44.288340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:19:44.289936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:44.289936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:44.289936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:19:44.289936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:44.289936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:19:44.289936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:44.289936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:44.289936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:44.289936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:44.289936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:44.289936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:44.289936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:44.289936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:44.289936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:44.289936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:44.289936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:44.289936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:44.289936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:44.290961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:44.290961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:44.290961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:19:44.290961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:19:44.290961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:19:44.290961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:19:44.290961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:19:44.290961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:19:44.290961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:19:44.290961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:44.290961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 537/1069] 10.222.0.25 () {56 vars in 1093 bytes} [Sat Sep 24 19:19:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:44.292694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4adc7b-983f-412b-88b2-05ee8739937d None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:44.292972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4adc7b-983f-412b-88b2-05ee8739937d None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:44.293242 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4adc7b-983f-412b-88b2-05ee8739937d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:44.311585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-0a4adc7b-983f-412b-88b2-05ee8739937d None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:44.312814 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-0a4adc7b-983f-412b-88b2-05ee8739937d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:44.362865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:44.367451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 533/1070] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:19:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 19:19:44.369029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dbcfa-60ad-45c8-aa0a-025d8c806f59 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:44.379142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 538/1071] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:44.379968 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4adc7b-983f-412b-88b2-05ee8739937d None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:44.476718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dbcfa-60ad-45c8-aa0a-025d8c806f59 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:44.488408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:44.492824 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4adc7b-983f-412b-88b2-05ee8739937d None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:44.514477 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf4639-277d-4eb0-a07b-45e29d1d113b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:44.515113 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf4639-277d-4eb0-a07b-45e29d1d113b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:44.515393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf4639-277d-4eb0-a07b-45e29d1d113b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:44.515662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf4639-277d-4eb0-a07b-45e29d1d113b None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:44.516388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf4639-277d-4eb0-a07b-45e29d1d113b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:44.516688 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf4639-277d-4eb0-a07b-45e29d1d113b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:44.518100 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf4639-277d-4eb0-a07b-45e29d1d113b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:44.530213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814233c-c327-414c-977d-5b7847416aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:44.530864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814233c-c327-414c-977d-5b7847416aca None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:44.531141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814233c-c327-414c-977d-5b7847416aca None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:44.531406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814233c-c327-414c-977d-5b7847416aca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:44.541365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 534/1072] 10.222.0.25 () {56 vars in 1133 bytes} [Sat Sep 24 19:19:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:44.542398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf4639-277d-4eb0-a07b-45e29d1d113b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:44.546613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814233c-c327-414c-977d-5b7847416aca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:44.548116 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814233c-c327-414c-977d-5b7847416aca None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:44.565526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-9814233c-c327-414c-977d-5b7847416aca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:44.565526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:44.565526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:44.565526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:44.565526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:44.565526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:44.565526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:44.565526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:44.565526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:44.565526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:44.565526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:44.565526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:44.565526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:44.565526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:44.565526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:44.565526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:44.566526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:44.566526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:44.566526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:44.566526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:44.566526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:44.566526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:44.566526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:44.566526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:44.566526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:44.566526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:44.566526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:44.566526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:44.566526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:44.566526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:44.566526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:44.566526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:44.566526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:44.567485 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:44.567485 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:44.567485 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:44.570988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 539/1073] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:44.573493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814233c-c327-414c-977d-5b7847416aca None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:44.599961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:44.646650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf4639-277d-4eb0-a07b-45e29d1d113b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:44.681506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf01046-04d9-4959-ba0c-a827d6f34297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:44.682132 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf01046-04d9-4959-ba0c-a827d6f34297 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:44.682246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814233c-c327-414c-977d-5b7847416aca None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:44.682410 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf01046-04d9-4959-ba0c-a827d6f34297 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:44.682679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf01046-04d9-4959-ba0c-a827d6f34297 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:44.692655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf01046-04d9-4959-ba0c-a827d6f34297 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:44.694095 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf01046-04d9-4959-ba0c-a827d6f34297 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:44.709857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-baf01046-04d9-4959-ba0c-a827d6f34297 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:44.709857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:44.709857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:44.709857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:44.709857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:44.709857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:44.709857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:44.709857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:44.709857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:44.709857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:44.709857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:44.709857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:44.709857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:44.709857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:44.709857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:44.709857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:44.711686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:44.711686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:44.711686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:44.711686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:44.711686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:44.711686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:44.711686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:44.711686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:44.711686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:44.711686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:44.711686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:44.711686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:44.711686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:44.711686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:44.711686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:44.711686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:44.711686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:44.717476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:44.717476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:44.717476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:44.717476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 535/1074] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:44.717476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf01046-04d9-4959-ba0c-a827d6f34297 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:44.717784 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fa2a8-9fc2-4d17-846f-9426a0ee8782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:44.717784 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fa2a8-9fc2-4d17-846f-9426a0ee8782 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:44.717784 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fa2a8-9fc2-4d17-846f-9426a0ee8782 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:44.717784 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fa2a8-9fc2-4d17-846f-9426a0ee8782 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:44.718265 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fa2a8-9fc2-4d17-846f-9426a0ee8782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:44.718518 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fa2a8-9fc2-4d17-846f-9426a0ee8782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:44.720041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fa2a8-9fc2-4d17-846f-9426a0ee8782 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:44.731932 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 540/1075] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:44.732737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fa2a8-9fc2-4d17-846f-9426a0ee8782 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:44.746410 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:44.833063 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf01046-04d9-4959-ba0c-a827d6f34297 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:44.843848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:44.852980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fa2a8-9fc2-4d17-846f-9426a0ee8782 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:44.874545 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d57cc9-7711-441d-a71f-7ec7627a6b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:44.875290 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d57cc9-7711-441d-a71f-7ec7627a6b79 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:44.875628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d57cc9-7711-441d-a71f-7ec7627a6b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:44.875909 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d57cc9-7711-441d-a71f-7ec7627a6b79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:44.888687 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d57cc9-7711-441d-a71f-7ec7627a6b79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:19:44.891454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6863a-e811-457f-9861-8a7b7078a7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:44.892276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6863a-e811-457f-9861-8a7b7078a7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:44.892752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6863a-e811-457f-9861-8a7b7078a7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:44.893197 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6863a-e811-457f-9861-8a7b7078a7f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:44.893625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-d5d57cc9-7711-441d-a71f-7ec7627a6b79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:19:44.893625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:44.893625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:44.893625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:44.893625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:44.893625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:44.893625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:44.893625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:44.893625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:44.893625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:44.893625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:44.893625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:44.893625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:19:44.893625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:19:44.893625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:19:44.893625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:19:44.894550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:19:44.894550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:19:44.894550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:19:44.894550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:19:44.894550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:44.894550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:44.894550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:44.894550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:44.894550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:44.894550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:44.894550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:44.894550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:44.894550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:44.894550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:44.894550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:44.894550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:44.895454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:44.895454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:44.895454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:44.895454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:44.895454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:19:44.895454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:19:44.895454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:19:44.895454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:19:44.895454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:19:44.895454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:19:44.895454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:19:44.895454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:44.895454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 536/1076] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:19:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:44.896853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6863a-e811-457f-9861-8a7b7078a7f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:44.897310 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6863a-e811-457f-9861-8a7b7078a7f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:44.900108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6863a-e811-457f-9861-8a7b7078a7f3 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:44.902733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d57cc9-7711-441d-a71f-7ec7627a6b79 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:44.912832 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 541/1077] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:44.919272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6863a-e811-457f-9861-8a7b7078a7f3 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:45.003456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:45.028897 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d57cc9-7711-441d-a71f-7ec7627a6b79 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:45.037685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6863a-e811-457f-9861-8a7b7078a7f3 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:45.067412 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a602e-71cd-4e65-91a3-41c0799c8e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:45.068021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a602e-71cd-4e65-91a3-41c0799c8e35 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:45.068298 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a602e-71cd-4e65-91a3-41c0799c8e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:45.068574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a602e-71cd-4e65-91a3-41c0799c8e35 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:45.069229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a602e-71cd-4e65-91a3-41c0799c8e35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:45.069534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a602e-71cd-4e65-91a3-41c0799c8e35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:45.071072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a602e-71cd-4e65-91a3-41c0799c8e35 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:45.073279 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a30da-a825-417b-a216-0bf42a5d6348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:45.073897 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a30da-a825-417b-a216-0bf42a5d6348 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:45.074169 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a30da-a825-417b-a216-0bf42a5d6348 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:45.074433 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a30da-a825-417b-a216-0bf42a5d6348 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:45.079957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 537/1078] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:19:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:45.082473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a30da-a825-417b-a216-0bf42a5d6348 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:45.084004 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a30da-a825-417b-a216-0bf42a5d6348 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:45.086606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a602e-71cd-4e65-91a3-41c0799c8e35 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:45.096550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-165a30da-a825-417b-a216-0bf42a5d6348 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:45.096550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:45.096550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:45.096550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:45.096550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:45.096550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:45.096550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:45.096550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:45.096550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:45.096550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:45.096550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:45.096550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:45.096550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:19:45.096550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:19:45.096550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:19:45.097731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:19:45.097731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:45.097731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:45.097731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:45.097731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:45.097731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:45.097731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:45.097731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:45.097731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:45.097731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:45.097731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:45.097731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:45.097731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:45.097731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:45.097731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:45.097731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:45.097731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:45.098713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:19:45.098713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:19:45.098713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:19:45.098713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:19:45.098713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:19:45.098713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:19:45.098713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:45.098713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:45.098713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 542/1079] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:19:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:45.103864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a30da-a825-417b-a216-0bf42a5d6348 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:45.119556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:45.189448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a602e-71cd-4e65-91a3-41c0799c8e35 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:45.202091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a30da-a825-417b-a216-0bf42a5d6348 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:45.223814 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde6df8-fd50-49de-9e71-20130d8d19f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:45.224435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde6df8-fd50-49de-9e71-20130d8d19f6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:45.224712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde6df8-fd50-49de-9e71-20130d8d19f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:45.224979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde6df8-fd50-49de-9e71-20130d8d19f6 None admin] PATH_INFO: `/v3/users/5a29a5ba0ee9435285f1087b99e9f26a` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:45.226607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde6df8-fd50-49de-9e71-20130d8d19f6 None admin] RBAC: Authorizing `identity:get_user(user_id=5a29a5ba0ee9435285f1087b99e9f26a)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:45.228055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde6df8-fd50-49de-9e71-20130d8d19f6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:45.229609 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 538/1080] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:19:45 2022] GET /identity/v3/users/5a29a5ba0ee9435285f1087b99e9f26a => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:45.230217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:45.235337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde6df8-fd50-49de-9e71-20130d8d19f6 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:45.241024 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05133b04-1eb2-4acb-aee8-f3295fed83b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:45.241629 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05133b04-1eb2-4acb-aee8-f3295fed83b2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:45.242055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05133b04-1eb2-4acb-aee8-f3295fed83b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:45.242435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05133b04-1eb2-4acb-aee8-f3295fed83b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:45.243153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05133b04-1eb2-4acb-aee8-f3295fed83b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:45.243514 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05133b04-1eb2-4acb-aee8-f3295fed83b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:45.245341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05133b04-1eb2-4acb-aee8-f3295fed83b2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:45.258499 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 543/1081] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:19:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:45.264316 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05133b04-1eb2-4acb-aee8-f3295fed83b2 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:45.334513 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:45.338922 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde6df8-fd50-49de-9e71-20130d8d19f6 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:45.361614 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05133b04-1eb2-4acb-aee8-f3295fed83b2 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:45.372894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87923b8d-e846-421b-9b65-743c935e5add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:45.373526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87923b8d-e846-421b-9b65-743c935e5add None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:45.373804 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87923b8d-e846-421b-9b65-743c935e5add None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:45.374080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87923b8d-e846-421b-9b65-743c935e5add None admin] PATH_INFO: `/v3/projects/6e008d51a04943ddb0ccb73921d5466e` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:45.375221 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87923b8d-e846-421b-9b65-743c935e5add None admin] RBAC: Authorizing `identity:get_project(project_id=6e008d51a04943ddb0ccb73921d5466e)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:45.376637 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87923b8d-e846-421b-9b65-743c935e5add None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:45.378475 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 539/1082] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:19:45 2022] GET /identity/v3/projects/6e008d51a04943ddb0ccb73921d5466e => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:45.384784 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87923b8d-e846-421b-9b65-743c935e5add None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:45.394651 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7054ea-656f-4a20-a7ab-8ccbf0a02948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:45.395335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7054ea-656f-4a20-a7ab-8ccbf0a02948 None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:45.395610 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7054ea-656f-4a20-a7ab-8ccbf0a02948 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:45.395881 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7054ea-656f-4a20-a7ab-8ccbf0a02948 None admin] PATH_INFO: `/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/4e5798be0fa544cf9cf48558e87fcfa9/roles/c350cad9e8c64a188a5f0b2bafe29a40` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:45.398027 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7054ea-656f-4a20-a7ab-8ccbf0a02948 None admin] RBAC: Authorizing `identity:create_grant(project_id=f61085f09512451e92c9fa36fa9a8071, user_id=4e5798be0fa544cf9cf48558e87fcfa9, role_id=c350cad9e8c64a188a5f0b2bafe29a40)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:45.400378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7054ea-656f-4a20-a7ab-8ccbf0a02948 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:45.413357 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 544/1083] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:19:45 2022] PUT /identity/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/4e5798be0fa544cf9cf48558e87fcfa9/roles/c350cad9e8c64a188a5f0b2bafe29a40 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:19:45.493134 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87923b8d-e846-421b-9b65-743c935e5add None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:45.529221 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf755a9-1fc9-470b-b232-0ac3e289c331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:45.529813 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf755a9-1fc9-470b-b232-0ac3e289c331 None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:45.530089 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf755a9-1fc9-470b-b232-0ac3e289c331 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:45.530363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf755a9-1fc9-470b-b232-0ac3e289c331 None admin] PATH_INFO: `/v3/projects/6e008d51a04943ddb0ccb73921d5466e/users/5a29a5ba0ee9435285f1087b99e9f26a/roles/dd27845a836a4f6ebece149dbebc59c0` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:45.532345 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf755a9-1fc9-470b-b232-0ac3e289c331 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e008d51a04943ddb0ccb73921d5466e, user_id=5a29a5ba0ee9435285f1087b99e9f26a, role_id=dd27845a836a4f6ebece149dbebc59c0)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:45.533801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf755a9-1fc9-470b-b232-0ac3e289c331 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:45.548385 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 540/1084] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:19:45 2022] PUT /identity/v3/projects/6e008d51a04943ddb0ccb73921d5466e/users/5a29a5ba0ee9435285f1087b99e9f26a/roles/dd27845a836a4f6ebece149dbebc59c0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:19:47.566244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1111d5e-15e3-4efa-bd2b-ab2ce0d4d21a None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:47.566808 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1111d5e-15e3-4efa-bd2b-ab2ce0d4d21a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:47.566808 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1111d5e-15e3-4efa-bd2b-ab2ce0d4d21a None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:47.568156 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 545/1085] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:47.574215 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec3441-477c-4c18-b269-f448292c8f05 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:47.574787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec3441-477c-4c18-b269-f448292c8f05 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:47.574787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec3441-477c-4c18-b269-f448292c8f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:47.595576 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-d9ec3441-477c-4c18-b269-f448292c8f05 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:47.596795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d9ec3441-477c-4c18-b269-f448292c8f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:47.619578 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:47.666370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 541/1086] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:47.698280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7076d1d-5888-4ef8-9af8-3856fda1063f None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:47.698567 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7076d1d-5888-4ef8-9af8-3856fda1063f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:47.698945 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7076d1d-5888-4ef8-9af8-3856fda1063f None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:47.700331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 546/1087] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:47.705683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910472a9-36e1-4804-8761-cf31392585ea None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:47.705975 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910472a9-36e1-4804-8761-cf31392585ea None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:47.706256 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910472a9-36e1-4804-8761-cf31392585ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:47.724138 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-910472a9-36e1-4804-8761-cf31392585ea None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:47.725313 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-910472a9-36e1-4804-8761-cf31392585ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:47.791625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 542/1088] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:47.932558 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7076d1d-5888-4ef8-9af8-3856fda1063f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:47.983177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:48.033442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7076d1d-5888-4ef8-9af8-3856fda1063f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:48.060990 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910472a9-36e1-4804-8761-cf31392585ea None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:48.067440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bcfaa-9915-4ec7-af31-3dccee469733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:48.068072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bcfaa-9915-4ec7-af31-3dccee469733 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:48.068349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bcfaa-9915-4ec7-af31-3dccee469733 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:48.068616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bcfaa-9915-4ec7-af31-3dccee469733 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:48.080153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790bcfaa-9915-4ec7-af31-3dccee469733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:19:48.084960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-790bcfaa-9915-4ec7-af31-3dccee469733 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:19:48.084960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:48.084960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:48.084960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:48.084960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:48.084960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:48.084960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:48.084960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:48.084960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:48.084960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:48.084960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:48.084960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:48.084960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:19:48.084960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:19:48.084960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:19:48.084960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:19:48.086186 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:19:48.086186 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:19:48.086186 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:19:48.086186 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:19:48.086186 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:48.086186 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:48.086186 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:48.086186 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:48.086186 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:48.086186 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:48.086186 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:48.086186 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:48.086186 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:48.086186 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:48.086186 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:48.086186 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:48.087081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:48.087081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:48.087081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:48.087081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:48.087081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:19:48.087081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:19:48.087081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:19:48.087081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:19:48.087081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:19:48.087081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:19:48.087081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 19:19:48.087081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:48.087081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 547/1089] 10.222.0.25 () {56 vars in 1120 bytes} [Sat Sep 24 19:19:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:48.092107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bcfaa-9915-4ec7-af31-3dccee469733 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:48.149076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:48.164719 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910472a9-36e1-4804-8761-cf31392585ea None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:48.191105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bcfaa-9915-4ec7-af31-3dccee469733 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:48.199162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd06fb2-eb79-479c-96da-4a17b78687c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:48.199795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd06fb2-eb79-479c-96da-4a17b78687c9 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:48.200076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd06fb2-eb79-479c-96da-4a17b78687c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:48.200343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd06fb2-eb79-479c-96da-4a17b78687c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:48.201779 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:48.210469 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd06fb2-eb79-479c-96da-4a17b78687c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:19:48.215341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-cdd06fb2-eb79-479c-96da-4a17b78687c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:19:48.215341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:48.215341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:48.215341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:48.215341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:48.215341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:48.215341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:48.215341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:48.215341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:48.215341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:48.215341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:48.215341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:48.215341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:19:48.215341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:19:48.215341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:19:48.215341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:19:48.216355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:19:48.216355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:19:48.216355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:19:48.216355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:19:48.216355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:48.216355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:48.216355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:48.216355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:48.216355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:48.216355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:48.216355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:48.216355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:48.216355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:48.216355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:48.216355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:48.216355 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:48.217240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:48.217240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:48.217240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:48.217240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:48.217240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:19:48.217240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:19:48.217240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:19:48.217240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:19:48.217240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:19:48.217240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:19:48.217240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:19:48.217240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:48.221452 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 543/1090] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:19:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:48.222272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd06fb2-eb79-479c-96da-4a17b78687c9 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:48.226570 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5940f5-0d31-45fd-b3b1-acadb5bae24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:48.227483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5940f5-0d31-45fd-b3b1-acadb5bae24e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:48.227755 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5940f5-0d31-45fd-b3b1-acadb5bae24e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:48.228023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5940f5-0d31-45fd-b3b1-acadb5bae24e None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:48.228670 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5940f5-0d31-45fd-b3b1-acadb5bae24e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:48.228966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5940f5-0d31-45fd-b3b1-acadb5bae24e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:48.230316 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5940f5-0d31-45fd-b3b1-acadb5bae24e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:48.238368 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 548/1091] 10.222.0.25 () {56 vars in 1115 bytes} [Sat Sep 24 19:19:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:48.244002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5940f5-0d31-45fd-b3b1-acadb5bae24e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:48.322375 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd06fb2-eb79-479c-96da-4a17b78687c9 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:48.343818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5940f5-0d31-45fd-b3b1-acadb5bae24e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:48.356678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d6f26-7715-49a0-9828-d5b4531e5222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:48.357285 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d6f26-7715-49a0-9828-d5b4531e5222 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:48.357563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d6f26-7715-49a0-9828-d5b4531e5222 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:48.357838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d6f26-7715-49a0-9828-d5b4531e5222 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:48.358510 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d6f26-7715-49a0-9828-d5b4531e5222 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:48.358799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d6f26-7715-49a0-9828-d5b4531e5222 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:48.360192 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d6f26-7715-49a0-9828-d5b4531e5222 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:48.369042 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 544/1092] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:19:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:48.375040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d6f26-7715-49a0-9828-d5b4531e5222 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:48.379015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc89246-8325-43ef-86f3-3431fab9faab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:48.379639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc89246-8325-43ef-86f3-3431fab9faab None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:48.379918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc89246-8325-43ef-86f3-3431fab9faab None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:48.380191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc89246-8325-43ef-86f3-3431fab9faab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:48.385583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:48.391106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc89246-8325-43ef-86f3-3431fab9faab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:48.392538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc89246-8325-43ef-86f3-3431fab9faab None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:48.406748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-2fc89246-8325-43ef-86f3-3431fab9faab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:48.406748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:48.406748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:48.406748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:48.406748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:48.406748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:48.406748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:48.406748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:48.406748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:48.406748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:48.406748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:48.406748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:48.406748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:48.406748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:48.406748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:48.406748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:48.412742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:48.412742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:48.412742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:48.412742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:48.412742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:48.412742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:48.412742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:48.412742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:48.412742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:48.412742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:48.412742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:48.412742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:48.412742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:48.412742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:48.412742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:48.412742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:48.412742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:48.414406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:48.414406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:48.414406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:48.414406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 549/1093] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:48.414406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc89246-8325-43ef-86f3-3431fab9faab None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:48.442659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:48.475740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d6f26-7715-49a0-9828-d5b4531e5222 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:48.510109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4fec7-bfec-473b-af3c-760dbec8d4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:48.510683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4fec7-bfec-473b-af3c-760dbec8d4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:48.510994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4fec7-bfec-473b-af3c-760dbec8d4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:48.511262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4fec7-bfec-473b-af3c-760dbec8d4f5 None admin] PATH_INFO: `/v3/users/5a29a5ba0ee9435285f1087b99e9f26a` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:48.512396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4fec7-bfec-473b-af3c-760dbec8d4f5 None admin] RBAC: Authorizing `identity:get_user(user_id=5a29a5ba0ee9435285f1087b99e9f26a)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:48.513887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4fec7-bfec-473b-af3c-760dbec8d4f5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:48.515411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 545/1094] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:19:48 2022] GET /identity/v3/users/5a29a5ba0ee9435285f1087b99e9f26a => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:48.520156 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc89246-8325-43ef-86f3-3431fab9faab None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:48.520998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4fec7-bfec-473b-af3c-760dbec8d4f5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:48.554420 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c3c4a-5847-4e61-b4e9-2d5b2fb25f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:48.555475 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c3c4a-5847-4e61-b4e9-2d5b2fb25f7d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:48.555959 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c3c4a-5847-4e61-b4e9-2d5b2fb25f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:48.556237 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c3c4a-5847-4e61-b4e9-2d5b2fb25f7d None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:48.556868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c3c4a-5847-4e61-b4e9-2d5b2fb25f7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:48.557164 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c3c4a-5847-4e61-b4e9-2d5b2fb25f7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:48.558517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c3c4a-5847-4e61-b4e9-2d5b2fb25f7d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:48.569943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 550/1095] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:48.575641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c3c4a-5847-4e61-b4e9-2d5b2fb25f7d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:48.598864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:48.622931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4fec7-bfec-473b-af3c-760dbec8d4f5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:48.657269 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8d0e2-dcfb-4a14-b24a-8cd020ff27f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:48.657869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8d0e2-dcfb-4a14-b24a-8cd020ff27f7 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:48.658149 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8d0e2-dcfb-4a14-b24a-8cd020ff27f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:48.658419 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8d0e2-dcfb-4a14-b24a-8cd020ff27f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:48.660670 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:48.677895 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c3c4a-5847-4e61-b4e9-2d5b2fb25f7d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:48.713856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c2816-74a8-4c62-9fbb-358ccc0cbda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:48.714476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c2816-74a8-4c62-9fbb-358ccc0cbda5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:48.714753 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c2816-74a8-4c62-9fbb-358ccc0cbda5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:48.715056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c2816-74a8-4c62-9fbb-358ccc0cbda5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:48.722575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c2816-74a8-4c62-9fbb-358ccc0cbda5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:48.724067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c2816-74a8-4c62-9fbb-358ccc0cbda5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:48.725164 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8d0e2-dcfb-4a14-b24a-8cd020ff27f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:48.726674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8d0e2-dcfb-4a14-b24a-8cd020ff27f7 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:48.735613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-f15c2816-74a8-4c62-9fbb-358ccc0cbda5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:19:48.735613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:48.735613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:48.735613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:48.735613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:48.735613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:48.735613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:48.735613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:48.735613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:48.735613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:48.735613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:48.735613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:48.735613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:19:48.735613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:19:48.735613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:19:48.735613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:19:48.736645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:48.736645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:48.736645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:19:48.736645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:48.736645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:19:48.736645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:19:48.736645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:48.736645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:48.736645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:48.736645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:48.736645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:48.736645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:48.736645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:48.736645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:48.736645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:48.736645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:48.736645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:48.736645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:48.737630 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:48.737630 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:48.737630 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:19:48.737630 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:19:48.737630 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:19:48.737630 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:19:48.737630 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:19:48.737630 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:19:48.737630 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:19:48.737630 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:19:48.737630 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 551/1096] 10.222.0.25 () {56 vars in 1093 bytes} [Sat Sep 24 19:19:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:19:48.742976 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c2816-74a8-4c62-9fbb-358ccc0cbda5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:48.806592 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:48.830122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 546/1097] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:19:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 19:19:48.836095 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8d0e2-dcfb-4a14-b24a-8cd020ff27f7 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:48.842024 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c2816-74a8-4c62-9fbb-358ccc0cbda5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:48.876290 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050064e-2347-4b7c-bca7-afaa5aa07598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:48.876889 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050064e-2347-4b7c-bca7-afaa5aa07598 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:48.877168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050064e-2347-4b7c-bca7-afaa5aa07598 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:48.877441 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050064e-2347-4b7c-bca7-afaa5aa07598 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:48.878152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050064e-2347-4b7c-bca7-afaa5aa07598 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:48.878458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050064e-2347-4b7c-bca7-afaa5aa07598 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:48.879907 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050064e-2347-4b7c-bca7-afaa5aa07598 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:48.897264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 552/1098] 10.222.0.25 () {56 vars in 1133 bytes} [Sat Sep 24 19:19:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:48.903503 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050064e-2347-4b7c-bca7-afaa5aa07598 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:48.906108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:48.934212 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8d0e2-dcfb-4a14-b24a-8cd020ff27f7 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:48.967600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d2bd1-5161-458d-95f2-8d9d2d7dc28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:48.968233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d2bd1-5161-458d-95f2-8d9d2d7dc28a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:48.968508 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d2bd1-5161-458d-95f2-8d9d2d7dc28a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:48.968781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d2bd1-5161-458d-95f2-8d9d2d7dc28a None admin] PATH_INFO: `/v3/projects/6e008d51a04943ddb0ccb73921d5466e` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:48.969896 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d2bd1-5161-458d-95f2-8d9d2d7dc28a None admin] RBAC: Authorizing `identity:get_project(project_id=6e008d51a04943ddb0ccb73921d5466e)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:48.971362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d2bd1-5161-458d-95f2-8d9d2d7dc28a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:48.973020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 547/1099] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:19:48 2022] GET /identity/v3/projects/6e008d51a04943ddb0ccb73921d5466e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:48.979597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d2bd1-5161-458d-95f2-8d9d2d7dc28a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:49.002173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050064e-2347-4b7c-bca7-afaa5aa07598 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:49.024492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:49.035882 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc22e6-9d94-4e69-9289-58b0a7c67607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:49.036482 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc22e6-9d94-4e69-9289-58b0a7c67607 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:49.036764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc22e6-9d94-4e69-9289-58b0a7c67607 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:49.037033 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc22e6-9d94-4e69-9289-58b0a7c67607 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:49.077807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d2bd1-5161-458d-95f2-8d9d2d7dc28a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:49.105346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc22e6-9d94-4e69-9289-58b0a7c67607 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:49.106871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc22e6-9d94-4e69-9289-58b0a7c67607 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:49.108649 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:49.112976 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b1dc5-700f-4b23-8bbd-fb75a023f11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:49.113585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b1dc5-700f-4b23-8bbd-fb75a023f11a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:49.113868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b1dc5-700f-4b23-8bbd-fb75a023f11a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:49.114136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b1dc5-700f-4b23-8bbd-fb75a023f11a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:49.114880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b1dc5-700f-4b23-8bbd-fb75a023f11a None admin] RBAC: Adding query filter params (role.id=dd27845a836a4f6ebece149dbebc59c0, scope.project.id=6e008d51a04943ddb0ccb73921d5466e, user.id=5a29a5ba0ee9435285f1087b99e9f26a) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:49.115193 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b1dc5-700f-4b23-8bbd-fb75a023f11a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:49.116630 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b1dc5-700f-4b23-8bbd-fb75a023f11a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:49.122471 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 548/1100] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:19:48 2022] GET /identity/v3/role_assignments?user.id=5a29a5ba0ee9435285f1087b99e9f26a&scope.project.id=6e008d51a04943ddb0ccb73921d5466e&role.id=dd27845a836a4f6ebece149dbebc59c0 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:49.211608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 553/1101] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:19:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 19:19:49.217577 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b1dc5-700f-4b23-8bbd-fb75a023f11a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:49.321571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b1dc5-700f-4b23-8bbd-fb75a023f11a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:49.331298 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:49.357344 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdfa57-a407-4684-b188-1dccad50384d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:49.357985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdfa57-a407-4684-b188-1dccad50384d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:49.358243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdfa57-a407-4684-b188-1dccad50384d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:49.358518 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacdfa57-a407-4684-b188-1dccad50384d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:49.368427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdfa57-a407-4684-b188-1dccad50384d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:49.369853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacdfa57-a407-4684-b188-1dccad50384d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:49.384084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-bacdfa57-a407-4684-b188-1dccad50384d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:49.384084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:49.384084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:49.384084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:49.384084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:49.384084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:49.384084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:49.384084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:49.384084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:49.384084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:49.384084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:49.384084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:49.384084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:19:49.384084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:19:49.384084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:19:49.384084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:19:49.385189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:49.385189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:49.385189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:49.385189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:49.385189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:49.385189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:49.385189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:49.385189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:49.385189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:49.385189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:49.385189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:49.385189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:49.385189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:49.385189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:49.385189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:49.385189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:49.385189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:19:49.386109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:19:49.386109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:19:49.386109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:49.386109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 549/1102] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:49.390979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc22e6-9d94-4e69-9289-58b0a7c67607 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:49.488196 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc22e6-9d94-4e69-9289-58b0a7c67607 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:49.489720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:49.522420 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4ede0-6ac5-4a86-b268-39b236596311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:49.523571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4ede0-6ac5-4a86-b268-39b236596311 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:49.524096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4ede0-6ac5-4a86-b268-39b236596311 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:49.524544 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4ede0-6ac5-4a86-b268-39b236596311 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:49.525172 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4ede0-6ac5-4a86-b268-39b236596311 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:49.525469 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4ede0-6ac5-4a86-b268-39b236596311 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:49.526821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4ede0-6ac5-4a86-b268-39b236596311 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:49.537719 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 554/1103] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:49.544003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdfa57-a407-4684-b188-1dccad50384d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:49.642380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacdfa57-a407-4684-b188-1dccad50384d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:49.675612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d98c2a-7617-4e99-a170-2f05b3298e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:49.676238 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d98c2a-7617-4e99-a170-2f05b3298e28 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:49.676516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d98c2a-7617-4e99-a170-2f05b3298e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:49.676789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d98c2a-7617-4e99-a170-2f05b3298e28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:49.683471 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d98c2a-7617-4e99-a170-2f05b3298e28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:49.684897 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d98c2a-7617-4e99-a170-2f05b3298e28 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:49.696454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-c6d98c2a-7617-4e99-a170-2f05b3298e28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:49.696454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:19:49.696454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:19:49.696454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:19:49.696454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:19:49.696454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:19:49.696454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:19:49.696454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:19:49.696454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:19:49.696454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:19:49.696454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:19:49.696454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:19:49.696454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:19:49.696454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:19:49.696454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:19:49.697551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:19:49.697551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:19:49.697551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:19:49.697551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:19:49.697551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:19:49.697551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:19:49.697551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:19:49.697551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:19:49.697551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:19:49.697551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:19:49.697551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:19:49.697551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:19:49.697551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:19:49.697551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:19:49.697551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:19:49.697551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:19:49.697551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:19:49.698746 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:19:49.698746 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:19:49.698746 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:19:49.698746 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:19:49.698746 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:19:49.698746 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:19:49.698746 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:19:49.698746 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:19:49.698746 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 550/1104] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:19:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:19:49.703475 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4ede0-6ac5-4a86-b268-39b236596311 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:49.799945 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4ede0-6ac5-4a86-b268-39b236596311 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:49.832935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50bd1c-8b7b-45b2-b830-24c4fe6568af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:49.833527 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50bd1c-8b7b-45b2-b830-24c4fe6568af None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:49.833798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50bd1c-8b7b-45b2-b830-24c4fe6568af None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:49.834064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50bd1c-8b7b-45b2-b830-24c4fe6568af None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:49.834728 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50bd1c-8b7b-45b2-b830-24c4fe6568af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:49.835057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50bd1c-8b7b-45b2-b830-24c4fe6568af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:49.837259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50bd1c-8b7b-45b2-b830-24c4fe6568af None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:49.848965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 555/1105] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:19:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:49.855526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d98c2a-7617-4e99-a170-2f05b3298e28 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:49.877674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:49.955765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d98c2a-7617-4e99-a170-2f05b3298e28 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:49.991345 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1fd4b-3bf8-471b-a0b8-17a9053c4494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:49.992453 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1fd4b-3bf8-471b-a0b8-17a9053c4494 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:49.992731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1fd4b-3bf8-471b-a0b8-17a9053c4494 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:49.993000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1fd4b-3bf8-471b-a0b8-17a9053c4494 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:49.993712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1fd4b-3bf8-471b-a0b8-17a9053c4494 None admin] RBAC: Adding query filter params (role.id=c350cad9e8c64a188a5f0b2bafe29a40, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=4e5798be0fa544cf9cf48558e87fcfa9) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:49.994017 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1fd4b-3bf8-471b-a0b8-17a9053c4494 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:49.995470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1fd4b-3bf8-471b-a0b8-17a9053c4494 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:50.001092 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 551/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:19:49 2022] GET /identity/v3/role_assignments?user.id=4e5798be0fa544cf9cf48558e87fcfa9&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=c350cad9e8c64a188a5f0b2bafe29a40 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:19:51.318933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6e4ba-c015-41f0-9aae-5ac4325255ee None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:51.319468 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6e4ba-c015-41f0-9aae-5ac4325255ee None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:51.319468 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6e4ba-c015-41f0-9aae-5ac4325255ee None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:51.320873 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 556/1107] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:51.326103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cc3bb-a1ac-4bb9-a788-cfd548b38e2f None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:51.326523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cc3bb-a1ac-4bb9-a788-cfd548b38e2f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:51.326633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cc3bb-a1ac-4bb9-a788-cfd548b38e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:51.344658 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-9e0cc3bb-a1ac-4bb9-a788-cfd548b38e2f None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:51.345830 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-9e0cc3bb-a1ac-4bb9-a788-cfd548b38e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:51.411042 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 552/1108] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:51.684394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6e4ba-c015-41f0-9aae-5ac4325255ee None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:51.708286 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:51.783231 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6e4ba-c015-41f0-9aae-5ac4325255ee None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:51.815729 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650878de-c5e6-4a2a-8be5-b95a65199f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:51.816330 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650878de-c5e6-4a2a-8be5-b95a65199f4b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:51.816602 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650878de-c5e6-4a2a-8be5-b95a65199f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:51.816867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650878de-c5e6-4a2a-8be5-b95a65199f4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:51.817941 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650878de-c5e6-4a2a-8be5-b95a65199f4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:51.819396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650878de-c5e6-4a2a-8be5-b95a65199f4b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:51.821234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 557/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:19:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:51.826925 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cc3bb-a1ac-4bb9-a788-cfd548b38e2f None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:51.841998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:51.924618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cc3bb-a1ac-4bb9-a788-cfd548b38e2f None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:51.958340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ece37b-9f55-4b14-9745-b06b50f08438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:51.958907 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ece37b-9f55-4b14-9745-b06b50f08438 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:51.959190 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ece37b-9f55-4b14-9745-b06b50f08438 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:51.959462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ece37b-9f55-4b14-9745-b06b50f08438 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:51.960108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ece37b-9f55-4b14-9745-b06b50f08438 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:51.962241 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ece37b-9f55-4b14-9745-b06b50f08438 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:51.983482 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 553/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Sat Sep 24 19:19:51 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:19:54.154592 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bd322-d80c-48b9-8fe6-e93b2e0bf19d None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:54.155159 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bd322-d80c-48b9-8fe6-e93b2e0bf19d None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:54.155159 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bd322-d80c-48b9-8fe6-e93b2e0bf19d None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:54.156469 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 558/1111] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:54.161571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a18d7-91f7-4795-9e88-c5c357a2a953 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:54.161993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a18d7-91f7-4795-9e88-c5c357a2a953 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:54.162113 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a18d7-91f7-4795-9e88-c5c357a2a953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:54.181143 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-3f1a18d7-91f7-4795-9e88-c5c357a2a953 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:54.182332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-3f1a18d7-91f7-4795-9e88-c5c357a2a953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:54.241304 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:54.247145 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 554/1112] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:54.522298 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bd322-d80c-48b9-8fe6-e93b2e0bf19d None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:54.612480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:54.623325 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bd322-d80c-48b9-8fe6-e93b2e0bf19d None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:54.658746 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b4d42-654b-43c3-9735-d98b9f268289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:54.659388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b4d42-654b-43c3-9735-d98b9f268289 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:54.659668 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b4d42-654b-43c3-9735-d98b9f268289 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:54.659942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b4d42-654b-43c3-9735-d98b9f268289 None admin] PATH_INFO: `/v3/roles/655c93c88bc34badbfd2aad45491a96b` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:54.661315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b4d42-654b-43c3-9735-d98b9f268289 None admin] RBAC: Authorizing `identity:get_role(role_id=655c93c88bc34badbfd2aad45491a96b)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:54.662669 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b4d42-654b-43c3-9735-d98b9f268289 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:54.664568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 559/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:19:54 2022] GET /identity/v3/roles/655c93c88bc34badbfd2aad45491a96b => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:54.670502 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a18d7-91f7-4795-9e88-c5c357a2a953 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:54.767106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a18d7-91f7-4795-9e88-c5c357a2a953 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:54.800853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62622f1d-a55b-450a-9bf9-48a778399bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:54.801475 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62622f1d-a55b-450a-9bf9-48a778399bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:54.801755 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62622f1d-a55b-450a-9bf9-48a778399bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:54.802030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62622f1d-a55b-450a-9bf9-48a778399bd5 None admin] PATH_INFO: `/v3/users/394462905c474932a0fdc51fe09df792` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:54.814853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62622f1d-a55b-450a-9bf9-48a778399bd5 None admin] RBAC: Authorizing `identity:get_user(user_id=394462905c474932a0fdc51fe09df792)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:54.816279 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62622f1d-a55b-450a-9bf9-48a778399bd5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:54.817846 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 555/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:19:54 2022] GET /identity/v3/users/394462905c474932a0fdc51fe09df792 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:54.823618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b4d42-654b-43c3-9735-d98b9f268289 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:54.920575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b4d42-654b-43c3-9735-d98b9f268289 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:54.953282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeaccd9-8d32-498c-bc54-7b5e05fb039e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:54.953873 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeaccd9-8d32-498c-bc54-7b5e05fb039e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:54.954149 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeaccd9-8d32-498c-bc54-7b5e05fb039e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:54.954419 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeaccd9-8d32-498c-bc54-7b5e05fb039e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:54.980293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:55.019408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeaccd9-8d32-498c-bc54-7b5e05fb039e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:55.020826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeaccd9-8d32-498c-bc54-7b5e05fb039e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:55.114915 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 560/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:19:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:19:55.120860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62622f1d-a55b-450a-9bf9-48a778399bd5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:55.178223 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:55.219944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62622f1d-a55b-450a-9bf9-48a778399bd5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:55.253108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afed5f5-5cc5-49f5-b2c9-b58c9b4fee1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:55.253728 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afed5f5-5cc5-49f5-b2c9-b58c9b4fee1f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:55.254008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afed5f5-5cc5-49f5-b2c9-b58c9b4fee1f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:55.254279 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afed5f5-5cc5-49f5-b2c9-b58c9b4fee1f None admin] PATH_INFO: `/v3/projects/6e008d51a04943ddb0ccb73921d5466e` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:55.255406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afed5f5-5cc5-49f5-b2c9-b58c9b4fee1f None admin] RBAC: Authorizing `identity:get_project(project_id=6e008d51a04943ddb0ccb73921d5466e)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:55.256821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afed5f5-5cc5-49f5-b2c9-b58c9b4fee1f None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:55.259014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 556/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:19:55 2022] GET /identity/v3/projects/6e008d51a04943ddb0ccb73921d5466e => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:55.265264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeaccd9-8d32-498c-bc54-7b5e05fb039e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:55.322359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:55.361309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeaccd9-8d32-498c-bc54-7b5e05fb039e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:55.393777 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db44dd-c761-483e-b3ff-6f2e0a19098c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:55.394362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db44dd-c761-483e-b3ff-6f2e0a19098c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:55.394640 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db44dd-c761-483e-b3ff-6f2e0a19098c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:55.394942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db44dd-c761-483e-b3ff-6f2e0a19098c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:55.395640 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db44dd-c761-483e-b3ff-6f2e0a19098c None admin] RBAC: Adding query filter params (role.id=655c93c88bc34badbfd2aad45491a96b, scope.project.id=6e008d51a04943ddb0ccb73921d5466e, user.id=394462905c474932a0fdc51fe09df792) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:19:55.395940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db44dd-c761-483e-b3ff-6f2e0a19098c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:55.397333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db44dd-c761-483e-b3ff-6f2e0a19098c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:55.402657 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 561/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:19:55 2022] GET /identity/v3/role_assignments?user.id=394462905c474932a0fdc51fe09df792&scope.project.id=6e008d51a04943ddb0ccb73921d5466e&role.id=655c93c88bc34badbfd2aad45491a96b => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:57.533078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44af3c-ee27-43ba-a9bb-7c07497a32dd None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:57.533593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44af3c-ee27-43ba-a9bb-7c07497a32dd None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:57.533679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44af3c-ee27-43ba-a9bb-7c07497a32dd None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:57.534976 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 557/1118] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:19:57.540187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b8049-b981-435a-9b1a-9f2b98a68b41 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:57.540606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b8049-b981-435a-9b1a-9f2b98a68b41 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:57.540720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b8049-b981-435a-9b1a-9f2b98a68b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:57.559051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-b23b8049-b981-435a-9b1a-9f2b98a68b41 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:19:57.560227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b23b8049-b981-435a-9b1a-9f2b98a68b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:19:57.624543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 562/1119] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:19:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:19:57.899450 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44af3c-ee27-43ba-a9bb-7c07497a32dd None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:57.997077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44af3c-ee27-43ba-a9bb-7c07497a32dd None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:58.021963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:58.031541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054df59b-edb7-4a77-a34e-14a156efc01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:58.032153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054df59b-edb7-4a77-a34e-14a156efc01d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:58.032428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054df59b-edb7-4a77-a34e-14a156efc01d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:58.032694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054df59b-edb7-4a77-a34e-14a156efc01d None admin] PATH_INFO: `/v3/roles/655c93c88bc34badbfd2aad45491a96b` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:58.034051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054df59b-edb7-4a77-a34e-14a156efc01d None admin] RBAC: Authorizing `identity:get_role(role_id=655c93c88bc34badbfd2aad45491a96b)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:58.035435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054df59b-edb7-4a77-a34e-14a156efc01d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:58.036736 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 558/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:19:57 2022] GET /identity/v3/roles/655c93c88bc34badbfd2aad45491a96b => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:58.042592 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b8049-b981-435a-9b1a-9f2b98a68b41 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:58.093400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:58.138285 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b8049-b981-435a-9b1a-9f2b98a68b41 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:58.171259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb67b81-3630-4cc4-8eb0-22e264dee33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:58.171817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb67b81-3630-4cc4-8eb0-22e264dee33f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:58.172095 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb67b81-3630-4cc4-8eb0-22e264dee33f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:58.172364 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb67b81-3630-4cc4-8eb0-22e264dee33f None admin] PATH_INFO: `/v3/users/394462905c474932a0fdc51fe09df792` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:58.173455 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb67b81-3630-4cc4-8eb0-22e264dee33f None admin] RBAC: Authorizing `identity:get_user(user_id=394462905c474932a0fdc51fe09df792)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:58.174878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb67b81-3630-4cc4-8eb0-22e264dee33f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:58.176427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 563/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:19:58 2022] GET /identity/v3/users/394462905c474932a0fdc51fe09df792 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:58.182269 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054df59b-edb7-4a77-a34e-14a156efc01d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:58.280144 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054df59b-edb7-4a77-a34e-14a156efc01d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:58.313424 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae9a84-9364-4a61-ab54-026731e3fd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:58.314039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae9a84-9364-4a61-ab54-026731e3fd38 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:58.314320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae9a84-9364-4a61-ab54-026731e3fd38 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:58.314594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae9a84-9364-4a61-ab54-026731e3fd38 None admin] PATH_INFO: `/v3/projects/6e008d51a04943ddb0ccb73921d5466e` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:58.315731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae9a84-9364-4a61-ab54-026731e3fd38 None admin] RBAC: Authorizing `identity:get_project(project_id=6e008d51a04943ddb0ccb73921d5466e)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:58.317145 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae9a84-9364-4a61-ab54-026731e3fd38 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:58.318749 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 559/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:19:58 2022] GET /identity/v3/projects/6e008d51a04943ddb0ccb73921d5466e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:19:58.325110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb67b81-3630-4cc4-8eb0-22e264dee33f None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:19:58.425237 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb67b81-3630-4cc4-8eb0-22e264dee33f None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:19:58.445284 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:19:58.458910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857be977-13de-4431-9af4-f68910021aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:19:58.459561 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857be977-13de-4431-9af4-f68910021aa4 None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:19:58.459839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857be977-13de-4431-9af4-f68910021aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:19:58.460137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857be977-13de-4431-9af4-f68910021aa4 None admin] PATH_INFO: `/v3/projects/6e008d51a04943ddb0ccb73921d5466e/users/394462905c474932a0fdc51fe09df792/roles/655c93c88bc34badbfd2aad45491a96b` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:19:58.462255 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857be977-13de-4431-9af4-f68910021aa4 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e008d51a04943ddb0ccb73921d5466e, user_id=394462905c474932a0fdc51fe09df792, role_id=655c93c88bc34badbfd2aad45491a96b)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:19:58.463746 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857be977-13de-4431-9af4-f68910021aa4 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:19:58.475570 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 564/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:19:58 2022] PUT /identity/v3/projects/6e008d51a04943ddb0ccb73921d5466e/users/394462905c474932a0fdc51fe09df792/roles/655c93c88bc34badbfd2aad45491a96b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:20:00.798772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bdffd-f9c5-4230-a27f-33bf80aa7634 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:00.799334 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bdffd-f9c5-4230-a27f-33bf80aa7634 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:00.799446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bdffd-f9c5-4230-a27f-33bf80aa7634 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:00.800703 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 560/1124] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:00.805906 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52faba5-48fa-4b1b-a595-e051d800d3c1 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:00.806352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52faba5-48fa-4b1b-a595-e051d800d3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:00.806446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52faba5-48fa-4b1b-a595-e051d800d3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:00.824409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-c52faba5-48fa-4b1b-a595-e051d800d3c1 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:00.825590 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c52faba5-48fa-4b1b-a595-e051d800d3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:00.889912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 565/1125] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:20:01.158134 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77bdffd-f9c5-4230-a27f-33bf80aa7634 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:01.220350 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:01.259479 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77bdffd-f9c5-4230-a27f-33bf80aa7634 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:01.292233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ff97a-afb3-4caa-9e48-702bd6b5edc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:01.292854 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ff97a-afb3-4caa-9e48-702bd6b5edc2 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:01.293134 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ff97a-afb3-4caa-9e48-702bd6b5edc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:01.293399 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ff97a-afb3-4caa-9e48-702bd6b5edc2 None admin] PATH_INFO: `/v3/roles/655c93c88bc34badbfd2aad45491a96b` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:01.294760 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ff97a-afb3-4caa-9e48-702bd6b5edc2 None admin] RBAC: Authorizing `identity:get_role(role_id=655c93c88bc34badbfd2aad45491a96b)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:01.296147 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ff97a-afb3-4caa-9e48-702bd6b5edc2 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:01.297444 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 561/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:01 2022] GET /identity/v3/roles/655c93c88bc34badbfd2aad45491a96b => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:01.303212 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52faba5-48fa-4b1b-a595-e051d800d3c1 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:01.398701 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52faba5-48fa-4b1b-a595-e051d800d3c1 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:01.409223 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:01.433906 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18c7cf-b08a-4e9b-a607-fc91e22f5069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:01.434529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18c7cf-b08a-4e9b-a607-fc91e22f5069 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:01.434802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18c7cf-b08a-4e9b-a607-fc91e22f5069 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:01.435096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18c7cf-b08a-4e9b-a607-fc91e22f5069 None admin] PATH_INFO: `/v3/users/394462905c474932a0fdc51fe09df792` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:01.436189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18c7cf-b08a-4e9b-a607-fc91e22f5069 None admin] RBAC: Authorizing `identity:get_user(user_id=394462905c474932a0fdc51fe09df792)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:01.437594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18c7cf-b08a-4e9b-a607-fc91e22f5069 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:01.439177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 566/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:01 2022] GET /identity/v3/users/394462905c474932a0fdc51fe09df792 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:01.445611 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ff97a-afb3-4caa-9e48-702bd6b5edc2 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:01.540502 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ff97a-afb3-4caa-9e48-702bd6b5edc2 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:01.567633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:01.574287 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14dd45-9d3b-477a-8aff-a64041dc59ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:01.574905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14dd45-9d3b-477a-8aff-a64041dc59ee None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:01.575182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14dd45-9d3b-477a-8aff-a64041dc59ee None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:01.575448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14dd45-9d3b-477a-8aff-a64041dc59ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:01.639665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14dd45-9d3b-477a-8aff-a64041dc59ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:01.641080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14dd45-9d3b-477a-8aff-a64041dc59ee None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:01.735887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 562/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:20:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:20:01.742429 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18c7cf-b08a-4e9b-a607-fc91e22f5069 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:01.840188 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18c7cf-b08a-4e9b-a607-fc91e22f5069 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:01.872755 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16073b92-1e52-4e08-86ac-1e3de30b7a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:01.873362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16073b92-1e52-4e08-86ac-1e3de30b7a62 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:01.873642 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16073b92-1e52-4e08-86ac-1e3de30b7a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:01.873915 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16073b92-1e52-4e08-86ac-1e3de30b7a62 None admin] PATH_INFO: `/v3/projects/6e008d51a04943ddb0ccb73921d5466e` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:01.875035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16073b92-1e52-4e08-86ac-1e3de30b7a62 None admin] RBAC: Authorizing `identity:get_project(project_id=6e008d51a04943ddb0ccb73921d5466e)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:01.876462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16073b92-1e52-4e08-86ac-1e3de30b7a62 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:01.878049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 567/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:20:01 2022] GET /identity/v3/projects/6e008d51a04943ddb0ccb73921d5466e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:01.884776 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14dd45-9d3b-477a-8aff-a64041dc59ee None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:01.914027 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:01.980882 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14dd45-9d3b-477a-8aff-a64041dc59ee None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:02.013553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3ee32-5b27-409a-85c3-bbb2b12c62f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:02.014076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3ee32-5b27-409a-85c3-bbb2b12c62f5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:02.014350 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3ee32-5b27-409a-85c3-bbb2b12c62f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:02.014617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3ee32-5b27-409a-85c3-bbb2b12c62f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:02.015354 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3ee32-5b27-409a-85c3-bbb2b12c62f5 None admin] RBAC: Adding query filter params (role.id=655c93c88bc34badbfd2aad45491a96b, scope.project.id=6e008d51a04943ddb0ccb73921d5466e, user.id=394462905c474932a0fdc51fe09df792) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:02.015659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3ee32-5b27-409a-85c3-bbb2b12c62f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:02.017069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3ee32-5b27-409a-85c3-bbb2b12c62f5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:02.023223 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 563/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:20:01 2022] GET /identity/v3/role_assignments?user.id=394462905c474932a0fdc51fe09df792&scope.project.id=6e008d51a04943ddb0ccb73921d5466e&role.id=655c93c88bc34badbfd2aad45491a96b => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:04.167045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bd8ab-1ef2-434b-9595-e8d2efb02d53 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:04.167582 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bd8ab-1ef2-434b-9595-e8d2efb02d53 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:04.167582 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bd8ab-1ef2-434b-9595-e8d2efb02d53 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:04.168904 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 568/1131] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:04.174125 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7389f1-d1df-4f23-bb56-a970254740ba None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:04.174558 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7389f1-d1df-4f23-bb56-a970254740ba None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:04.174663 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7389f1-d1df-4f23-bb56-a970254740ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:04.192927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-9c7389f1-d1df-4f23-bb56-a970254740ba None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:04.194085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-9c7389f1-d1df-4f23-bb56-a970254740ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:04.258681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 564/1132] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:20:04.529287 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bd8ab-1ef2-434b-9595-e8d2efb02d53 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:04.576106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:04.627588 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bd8ab-1ef2-434b-9595-e8d2efb02d53 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:04.660268 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ea857-5974-4d3a-99aa-6255b6f875e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:04.660900 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ea857-5974-4d3a-99aa-6255b6f875e1 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:04.661159 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ea857-5974-4d3a-99aa-6255b6f875e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:04.661428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ea857-5974-4d3a-99aa-6255b6f875e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:04.662522 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ea857-5974-4d3a-99aa-6255b6f875e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:04.664573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ea857-5974-4d3a-99aa-6255b6f875e1 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:04.666110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 569/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:20:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:04.671938 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7389f1-d1df-4f23-bb56-a970254740ba None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:04.696348 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:04.770148 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7389f1-d1df-4f23-bb56-a970254740ba None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:04.804373 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdf18e-a9fc-4ede-aa99-cf486ea4d3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:04.804961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdf18e-a9fc-4ede-aa99-cf486ea4d3f6 None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:04.805237 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdf18e-a9fc-4ede-aa99-cf486ea4d3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:04.805506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdf18e-a9fc-4ede-aa99-cf486ea4d3f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:04.806136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdf18e-a9fc-4ede-aa99-cf486ea4d3f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:04.807579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdf18e-a9fc-4ede-aa99-cf486ea4d3f6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:04.832720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 565/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Sat Sep 24 19:20:04 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:20:07.010165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acf83e-be2c-4838-a527-9de4c7aae8a6 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:07.010699 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acf83e-be2c-4838-a527-9de4c7aae8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:07.010699 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acf83e-be2c-4838-a527-9de4c7aae8a6 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:07.012064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 570/1135] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:07.017334 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c1148-13bb-4e94-89fc-4b7d49791bcc None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:07.017722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c1148-13bb-4e94-89fc-4b7d49791bcc None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:07.017878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c1148-13bb-4e94-89fc-4b7d49791bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:07.036459 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-530c1148-13bb-4e94-89fc-4b7d49791bcc None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:07.037626 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-530c1148-13bb-4e94-89fc-4b7d49791bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:07.102685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 566/1136] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:20:07.373104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acf83e-be2c-4838-a527-9de4c7aae8a6 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:07.472869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acf83e-be2c-4838-a527-9de4c7aae8a6 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:07.486206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:07.509184 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c677b-54b4-4c3b-86d3-4316b4f04572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:07.509805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c677b-54b4-4c3b-86d3-4316b4f04572 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:07.510086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c677b-54b4-4c3b-86d3-4316b4f04572 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:07.510359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c677b-54b4-4c3b-86d3-4316b4f04572 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:07.511607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c677b-54b4-4c3b-86d3-4316b4f04572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:07.513032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c677b-54b4-4c3b-86d3-4316b4f04572 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:07.514590 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 571/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:20:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:07.520382 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c1148-13bb-4e94-89fc-4b7d49791bcc None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:07.529248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:07.619027 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c1148-13bb-4e94-89fc-4b7d49791bcc None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:07.651965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addce8f2-69cc-4ae7-95ad-0e9946f3761d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:07.652493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addce8f2-69cc-4ae7-95ad-0e9946f3761d None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:07.652766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addce8f2-69cc-4ae7-95ad-0e9946f3761d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:07.653032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addce8f2-69cc-4ae7-95ad-0e9946f3761d None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:07.653658 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addce8f2-69cc-4ae7-95ad-0e9946f3761d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:07.655097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addce8f2-69cc-4ae7-95ad-0e9946f3761d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:07.676514 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 567/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Sat Sep 24 19:20:07 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:20:09.860119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caa20a-eff9-44c9-9d2b-2654555eb5a8 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:09.860696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caa20a-eff9-44c9-9d2b-2654555eb5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:09.860696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71caa20a-eff9-44c9-9d2b-2654555eb5a8 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:09.861980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 572/1139] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:09.867707 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421b79e-aa9c-42da-99c3-effa5f4667bc None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:09.868109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421b79e-aa9c-42da-99c3-effa5f4667bc None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:09.868251 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421b79e-aa9c-42da-99c3-effa5f4667bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:09.886678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-1421b79e-aa9c-42da-99c3-effa5f4667bc None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:09.887895 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1421b79e-aa9c-42da-99c3-effa5f4667bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:09.943146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:09.954130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 568/1140] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:20:10.222959 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71caa20a-eff9-44c9-9d2b-2654555eb5a8 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:10.321842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71caa20a-eff9-44c9-9d2b-2654555eb5a8 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:10.354023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174d7be-a26d-4a66-96af-6c25e6057cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:10.354629 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174d7be-a26d-4a66-96af-6c25e6057cde None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:10.354936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174d7be-a26d-4a66-96af-6c25e6057cde None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:10.355208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174d7be-a26d-4a66-96af-6c25e6057cde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:10.364920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174d7be-a26d-4a66-96af-6c25e6057cde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:20:10.370128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-2174d7be-a26d-4a66-96af-6c25e6057cde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:10.370128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:10.370128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:10.370128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:10.370128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:10.370128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:10.370128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:10.370128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:10.370128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:10.370128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:10.370128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:10.370128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:10.370128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:20:10.370128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:20:10.370128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:20:10.370128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:20:10.371280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:20:10.371280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:20:10.371280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:20:10.371280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:20:10.371280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:10.371280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:10.371280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:10.371280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:10.371280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:10.371280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:10.371280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:10.371280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:10.371280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:10.371280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:10.371280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:10.371280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:10.372168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:10.372168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:10.372168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:10.372168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:10.372168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:20:10.372168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:20:10.372168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:20:10.372168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:20:10.372168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:20:10.372168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:20:10.372168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:10.372168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:20:10.372168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 573/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:20:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:20:10.377201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421b79e-aa9c-42da-99c3-effa5f4667bc None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:10.474422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421b79e-aa9c-42da-99c3-effa5f4667bc None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:10.508214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566ccca-c058-4c73-b989-b8b5362cd4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:10.508810 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566ccca-c058-4c73-b989-b8b5362cd4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:10.509087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566ccca-c058-4c73-b989-b8b5362cd4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:10.509359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566ccca-c058-4c73-b989-b8b5362cd4a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:10.510012 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566ccca-c058-4c73-b989-b8b5362cd4a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:10.510311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566ccca-c058-4c73-b989-b8b5362cd4a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:10.511686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566ccca-c058-4c73-b989-b8b5362cd4a5 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:10.519421 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 569/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:20:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:10.525929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174d7be-a26d-4a66-96af-6c25e6057cde None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:10.568524 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:10.624052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174d7be-a26d-4a66-96af-6c25e6057cde None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:10.657092 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa96583-a5fa-410b-a940-75f6d3294267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:10.657704 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa96583-a5fa-410b-a940-75f6d3294267 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:10.657982 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa96583-a5fa-410b-a940-75f6d3294267 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:10.658253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa96583-a5fa-410b-a940-75f6d3294267 None admin] PATH_INFO: `/v3/users/7d8095d7a0da4e91927d2415d9885fd1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:10.671554 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa96583-a5fa-410b-a940-75f6d3294267 None admin] RBAC: Authorizing `identity:get_user(user_id=7d8095d7a0da4e91927d2415d9885fd1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:10.672985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa96583-a5fa-410b-a940-75f6d3294267 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:10.674546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 574/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:10 2022] GET /identity/v3/users/7d8095d7a0da4e91927d2415d9885fd1 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:10.681112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566ccca-c058-4c73-b989-b8b5362cd4a5 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:10.734483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:10.779810 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566ccca-c058-4c73-b989-b8b5362cd4a5 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:10.813410 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf59b7-3aa5-44f4-b322-02cbbb5bef97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:10.814002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf59b7-3aa5-44f4-b322-02cbbb5bef97 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:10.814281 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf59b7-3aa5-44f4-b322-02cbbb5bef97 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:10.814548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf59b7-3aa5-44f4-b322-02cbbb5bef97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:10.879212 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf59b7-3aa5-44f4-b322-02cbbb5bef97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:10.880641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf59b7-3aa5-44f4-b322-02cbbb5bef97 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:10.933039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:10.976566 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 570/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:20:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:20:10.982616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa96583-a5fa-410b-a940-75f6d3294267 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:11.076231 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:11.078919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa96583-a5fa-410b-a940-75f6d3294267 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:11.112679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806a366-0d88-44b7-b035-78a93111e68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:11.113300 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806a366-0d88-44b7-b035-78a93111e68d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:11.113578 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806a366-0d88-44b7-b035-78a93111e68d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:11.113852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806a366-0d88-44b7-b035-78a93111e68d None admin] PATH_INFO: `/v3/projects/12cbac8b6b0b439abdc1ddfed69a52e4` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:11.114989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806a366-0d88-44b7-b035-78a93111e68d None admin] RBAC: Authorizing `identity:get_project(project_id=12cbac8b6b0b439abdc1ddfed69a52e4)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:11.116675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806a366-0d88-44b7-b035-78a93111e68d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:11.118274 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 575/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:20:10 2022] GET /identity/v3/projects/12cbac8b6b0b439abdc1ddfed69a52e4 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:11.124301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf59b7-3aa5-44f4-b322-02cbbb5bef97 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:11.220653 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf59b7-3aa5-44f4-b322-02cbbb5bef97 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:11.253960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945080f-eb48-491c-819c-a47c1d492b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:11.254548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945080f-eb48-491c-819c-a47c1d492b84 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:11.254876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945080f-eb48-491c-819c-a47c1d492b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:11.255154 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945080f-eb48-491c-819c-a47c1d492b84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:11.255867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945080f-eb48-491c-819c-a47c1d492b84 None admin] RBAC: Adding query filter params (role.id=dd27845a836a4f6ebece149dbebc59c0, scope.project.id=12cbac8b6b0b439abdc1ddfed69a52e4, user.id=7d8095d7a0da4e91927d2415d9885fd1) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:11.256175 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945080f-eb48-491c-819c-a47c1d492b84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:11.257753 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945080f-eb48-491c-819c-a47c1d492b84 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:11.263019 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 571/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:20:11 2022] GET /identity/v3/role_assignments?user.id=7d8095d7a0da4e91927d2415d9885fd1&scope.project.id=12cbac8b6b0b439abdc1ddfed69a52e4&role.id=dd27845a836a4f6ebece149dbebc59c0 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:13.377825 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cf5e7-f990-4474-8e14-3cb4ee378978 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:13.378370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cf5e7-f990-4474-8e14-3cb4ee378978 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:13.378370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cf5e7-f990-4474-8e14-3cb4ee378978 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:13.379715 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 576/1147] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:13.385199 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47274428-05f0-4be2-a128-f8c882a4c589 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:13.385622 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47274428-05f0-4be2-a128-f8c882a4c589 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:13.385765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47274428-05f0-4be2-a128-f8c882a4c589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:13.404296 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-47274428-05f0-4be2-a128-f8c882a4c589 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:13.405461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-47274428-05f0-4be2-a128-f8c882a4c589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:13.418921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:13.471654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 572/1148] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:20:13.743807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cf5e7-f990-4474-8e14-3cb4ee378978 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:13.841958 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cf5e7-f990-4474-8e14-3cb4ee378978 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:13.875566 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9320d-7b46-42a7-93a3-47cf75b033d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:13.876180 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9320d-7b46-42a7-93a3-47cf75b033d7 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:13.876460 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9320d-7b46-42a7-93a3-47cf75b033d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:13.876731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9320d-7b46-42a7-93a3-47cf75b033d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:13.886553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9320d-7b46-42a7-93a3-47cf75b033d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:20:13.891324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-8ef9320d-7b46-42a7-93a3-47cf75b033d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:13.891324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:13.891324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:13.891324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:13.891324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:13.891324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:13.891324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:13.891324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:13.891324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:13.891324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:13.891324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:13.891324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:13.891324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:20:13.891324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:20:13.891324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:20:13.891324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:20:13.892396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:20:13.892396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:20:13.892396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:20:13.892396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:20:13.892396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:13.892396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:13.892396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:13.892396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:13.892396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:13.892396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:13.892396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:13.892396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:13.892396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:13.892396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:13.892396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:13.892396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:13.893467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:13.893467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:13.893467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:13.893467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:13.893467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:20:13.893467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:20:13.893467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:20:13.893467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:20:13.893467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:20:13.893467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:20:13.893467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:13.893467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:20:13.893467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 577/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:20:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:20:13.898883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47274428-05f0-4be2-a128-f8c882a4c589 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:13.995606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47274428-05f0-4be2-a128-f8c882a4c589 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:14.028538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d80a8-9e26-4348-be47-2943c3e439df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:14.029127 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d80a8-9e26-4348-be47-2943c3e439df None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:14.029402 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d80a8-9e26-4348-be47-2943c3e439df None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:14.029672 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d80a8-9e26-4348-be47-2943c3e439df None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:14.030321 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d80a8-9e26-4348-be47-2943c3e439df None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:14.030621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d80a8-9e26-4348-be47-2943c3e439df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:14.031997 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d80a8-9e26-4348-be47-2943c3e439df None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:14.040251 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 573/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:20:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:14.045969 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9320d-7b46-42a7-93a3-47cf75b033d7 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:14.073538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:14.142838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9320d-7b46-42a7-93a3-47cf75b033d7 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:14.176858 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5410fd8-9660-4fe3-8e68-dadeb3cceb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:14.177458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5410fd8-9660-4fe3-8e68-dadeb3cceb85 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:14.177735 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5410fd8-9660-4fe3-8e68-dadeb3cceb85 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:14.178003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5410fd8-9660-4fe3-8e68-dadeb3cceb85 None admin] PATH_INFO: `/v3/users/7d8095d7a0da4e91927d2415d9885fd1` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:14.179248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5410fd8-9660-4fe3-8e68-dadeb3cceb85 None admin] RBAC: Authorizing `identity:get_user(user_id=7d8095d7a0da4e91927d2415d9885fd1)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:14.180660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5410fd8-9660-4fe3-8e68-dadeb3cceb85 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:14.182194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 578/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:14 2022] GET /identity/v3/users/7d8095d7a0da4e91927d2415d9885fd1 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:14.187959 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d80a8-9e26-4348-be47-2943c3e439df None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:14.200568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:14.289827 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d80a8-9e26-4348-be47-2943c3e439df None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:14.322143 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b9a81-457c-4441-9b1d-06e247a13f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:14.322764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b9a81-457c-4441-9b1d-06e247a13f8b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:14.323074 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b9a81-457c-4441-9b1d-06e247a13f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:14.323351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b9a81-457c-4441-9b1d-06e247a13f8b None admin] PATH_INFO: `/v3/projects/12cbac8b6b0b439abdc1ddfed69a52e4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:14.324451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b9a81-457c-4441-9b1d-06e247a13f8b None admin] RBAC: Authorizing `identity:get_project(project_id=12cbac8b6b0b439abdc1ddfed69a52e4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:14.325863 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b9a81-457c-4441-9b1d-06e247a13f8b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:14.327506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 574/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:20:14 2022] GET /identity/v3/projects/12cbac8b6b0b439abdc1ddfed69a52e4 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:14.333308 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5410fd8-9660-4fe3-8e68-dadeb3cceb85 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:14.425165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:14.432205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5410fd8-9660-4fe3-8e68-dadeb3cceb85 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:14.464862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac096d-e3f5-4f61-a709-8486ec8957e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:14.465505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac096d-e3f5-4f61-a709-8486ec8957e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:14.465781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac096d-e3f5-4f61-a709-8486ec8957e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:14.466052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac096d-e3f5-4f61-a709-8486ec8957e7 None admin] PATH_INFO: `/v3/projects/12cbac8b6b0b439abdc1ddfed69a52e4/users/7d8095d7a0da4e91927d2415d9885fd1/roles/dd27845a836a4f6ebece149dbebc59c0` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:14.467925 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac096d-e3f5-4f61-a709-8486ec8957e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=12cbac8b6b0b439abdc1ddfed69a52e4, user_id=7d8095d7a0da4e91927d2415d9885fd1, role_id=dd27845a836a4f6ebece149dbebc59c0)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:14.469338 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac096d-e3f5-4f61-a709-8486ec8957e7 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:14.482772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 579/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:20:14 2022] PUT /identity/v3/projects/12cbac8b6b0b439abdc1ddfed69a52e4/users/7d8095d7a0da4e91927d2415d9885fd1/roles/dd27845a836a4f6ebece149dbebc59c0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:20:16.606577 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b37ad7-9504-4410-9ff8-9cfb564f1204 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:16.607206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b37ad7-9504-4410-9ff8-9cfb564f1204 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:16.607206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b37ad7-9504-4410-9ff8-9cfb564f1204 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:16.608473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 575/1154] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:20:16.613732 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4302b5a-e98a-42c8-a526-d1b205381eca None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:16.614154 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4302b5a-e98a-42c8-a526-d1b205381eca None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:16.614267 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4302b5a-e98a-42c8-a526-d1b205381eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:16.633043 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-e4302b5a-e98a-42c8-a526-d1b205381eca None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:16.634213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e4302b5a-e98a-42c8-a526-d1b205381eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:16.698710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 580/1155] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:20:16.966965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b37ad7-9504-4410-9ff8-9cfb564f1204 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:17.045153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:17.068202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b37ad7-9504-4410-9ff8-9cfb564f1204 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:17.102811 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff5237-920d-48d2-8aa3-344e5af7c2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:17.103452 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff5237-920d-48d2-8aa3-344e5af7c2be None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:17.103724 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff5237-920d-48d2-8aa3-344e5af7c2be None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:17.103989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff5237-920d-48d2-8aa3-344e5af7c2be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:17.114777 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff5237-920d-48d2-8aa3-344e5af7c2be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:20:17.119538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-97ff5237-920d-48d2-8aa3-344e5af7c2be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:17.119538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:17.119538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:17.119538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:17.119538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:17.119538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:17.119538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:17.119538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:17.119538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:17.119538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:17.119538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:17.119538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:17.119538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:20:17.119538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:20:17.119538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:20:17.119538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:20:17.120744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:20:17.120744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:20:17.120744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:20:17.120744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:20:17.120744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:17.120744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:17.120744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:17.120744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:17.120744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:17.120744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:17.120744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:17.120744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:17.120744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:17.120744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:17.120744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:17.120744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:17.121870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:17.121870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:17.121870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:17.121870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:17.121870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:20:17.121870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:20:17.121870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:20:17.121870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:20:17.121870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:20:17.121870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:20:17.121870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:17.121870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:20:17.121870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 576/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:20:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:20:17.126773 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4302b5a-e98a-42c8-a526-d1b205381eca None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:17.207758 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:17.223015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4302b5a-e98a-42c8-a526-d1b205381eca None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:17.255601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb14d16-fba3-4fdd-980e-9b3dff1d1831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:17.256191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb14d16-fba3-4fdd-980e-9b3dff1d1831 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:17.256597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb14d16-fba3-4fdd-980e-9b3dff1d1831 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:17.256868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb14d16-fba3-4fdd-980e-9b3dff1d1831 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:17.257516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb14d16-fba3-4fdd-980e-9b3dff1d1831 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:17.257815 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb14d16-fba3-4fdd-980e-9b3dff1d1831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:17.259218 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb14d16-fba3-4fdd-980e-9b3dff1d1831 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:17.266974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 581/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:20:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:17.273483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff5237-920d-48d2-8aa3-344e5af7c2be None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:17.370214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff5237-920d-48d2-8aa3-344e5af7c2be None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:17.402835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b0553-b587-45ab-96ce-dab14692fd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:17.403459 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b0553-b587-45ab-96ce-dab14692fd04 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:17.403732 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b0553-b587-45ab-96ce-dab14692fd04 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:17.404000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b0553-b587-45ab-96ce-dab14692fd04 None admin] PATH_INFO: `/v3/users/7d8095d7a0da4e91927d2415d9885fd1` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:17.405085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b0553-b587-45ab-96ce-dab14692fd04 None admin] RBAC: Authorizing `identity:get_user(user_id=7d8095d7a0da4e91927d2415d9885fd1)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:17.406490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b0553-b587-45ab-96ce-dab14692fd04 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:17.408060 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 577/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:17 2022] GET /identity/v3/users/7d8095d7a0da4e91927d2415d9885fd1 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:17.414026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb14d16-fba3-4fdd-980e-9b3dff1d1831 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:17.510398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb14d16-fba3-4fdd-980e-9b3dff1d1831 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:17.542977 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ae963-d481-43fe-97da-f8b8e2bbc95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:17.543568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ae963-d481-43fe-97da-f8b8e2bbc95f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:17.543842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ae963-d481-43fe-97da-f8b8e2bbc95f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:17.544110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ae963-d481-43fe-97da-f8b8e2bbc95f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:17.560897 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:17.610064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ae963-d481-43fe-97da-f8b8e2bbc95f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:17.611533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ae963-d481-43fe-97da-f8b8e2bbc95f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:17.705297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 582/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:20:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:20:17.711743 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b0553-b587-45ab-96ce-dab14692fd04 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:17.720769 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:17.810204 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b0553-b587-45ab-96ce-dab14692fd04 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:17.842805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbce246-4f81-4d6a-be20-bb5463e30750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:17.843438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbce246-4f81-4d6a-be20-bb5463e30750 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:17.843713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbce246-4f81-4d6a-be20-bb5463e30750 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:17.843982 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbce246-4f81-4d6a-be20-bb5463e30750 None admin] PATH_INFO: `/v3/projects/12cbac8b6b0b439abdc1ddfed69a52e4` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:17.845072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbce246-4f81-4d6a-be20-bb5463e30750 None admin] RBAC: Authorizing `identity:get_project(project_id=12cbac8b6b0b439abdc1ddfed69a52e4)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:17.846480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbce246-4f81-4d6a-be20-bb5463e30750 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:17.848092 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 578/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:20:17 2022] GET /identity/v3/projects/12cbac8b6b0b439abdc1ddfed69a52e4 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:17.854222 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ae963-d481-43fe-97da-f8b8e2bbc95f None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:17.904455 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:17.953123 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ae963-d481-43fe-97da-f8b8e2bbc95f None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:17.985083 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b8ddb-6158-4252-8680-be331e62f051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:17.985681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b8ddb-6158-4252-8680-be331e62f051 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:17.985959 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b8ddb-6158-4252-8680-be331e62f051 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:17.986230 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b8ddb-6158-4252-8680-be331e62f051 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:17.987011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b8ddb-6158-4252-8680-be331e62f051 None admin] RBAC: Adding query filter params (role.id=dd27845a836a4f6ebece149dbebc59c0, scope.project.id=12cbac8b6b0b439abdc1ddfed69a52e4, user.id=7d8095d7a0da4e91927d2415d9885fd1) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:17.987318 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b8ddb-6158-4252-8680-be331e62f051 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:17.988727 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b8ddb-6158-4252-8680-be331e62f051 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:17.995092 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 583/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:20:17 2022] GET /identity/v3/role_assignments?user.id=7d8095d7a0da4e91927d2415d9885fd1&scope.project.id=12cbac8b6b0b439abdc1ddfed69a52e4&role.id=dd27845a836a4f6ebece149dbebc59c0 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:20.151497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98dbc0-ea79-43b6-89e0-ba8d6d94e191 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:20.152034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98dbc0-ea79-43b6-89e0-ba8d6d94e191 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:20.152034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98dbc0-ea79-43b6-89e0-ba8d6d94e191 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:20.153376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 579/1162] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:20.158507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcbce9-e298-4d4f-856d-2d3b382899c2 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:20.158931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcbce9-e298-4d4f-856d-2d3b382899c2 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:20.159100 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcbce9-e298-4d4f-856d-2d3b382899c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:20.177446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-73fcbce9-e298-4d4f-856d-2d3b382899c2 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:20.178954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-73fcbce9-e298-4d4f-856d-2d3b382899c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:20.242918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 584/1163] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:20:20.512188 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98dbc0-ea79-43b6-89e0-ba8d6d94e191 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:20.592959 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:20.618518 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98dbc0-ea79-43b6-89e0-ba8d6d94e191 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:20.652275 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817bb5b-8225-4ae2-96f9-025e055dba28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:20.652879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817bb5b-8225-4ae2-96f9-025e055dba28 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:20.653160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817bb5b-8225-4ae2-96f9-025e055dba28 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:20.653435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817bb5b-8225-4ae2-96f9-025e055dba28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:20.718648 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817bb5b-8225-4ae2-96f9-025e055dba28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:20.720061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817bb5b-8225-4ae2-96f9-025e055dba28 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:20.790617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:20.815724 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 580/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:20:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:20:20.822670 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcbce9-e298-4d4f-856d-2d3b382899c2 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:20.864379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:20.919810 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcbce9-e298-4d4f-856d-2d3b382899c2 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:20.952499 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cba309-fec5-4b70-9446-9a395f76812e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:20.953107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cba309-fec5-4b70-9446-9a395f76812e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:20.953385 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cba309-fec5-4b70-9446-9a395f76812e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:20.953651 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cba309-fec5-4b70-9446-9a395f76812e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:20.960738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cba309-fec5-4b70-9446-9a395f76812e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:20.962153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cba309-fec5-4b70-9446-9a395f76812e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:20.980654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-29cba309-fec5-4b70-9446-9a395f76812e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 24 19:20:20.980654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:20.980654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 24 19:20:20.980654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 24 19:20:20.980654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:20:20.980654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:20:20.980654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:20:20.980654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:20:20.980654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 24 19:20:20.980654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:20:20.980654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:20:20.980654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:20:20.980654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:20.980654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:20.980654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:20.980654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:20.980654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:20.981919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:20.981919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:20.981919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:20.981919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:20.981919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:20.981919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:20.981919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:20:20.981919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:20:20.981919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:20:20.981919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:20:20.981919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:20.981919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:20.981919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:20.981919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:20.981919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:20.981919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:20.983076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:20.983076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:20.983076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:20.983076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:20.983076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:20.983076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:20.983076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:20.983076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:20.983076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:20.983076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:20.983076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 24 19:20:20.983076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:20:20.983076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 24 19:20:20.983076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:20:20.983076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 585/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Sat Sep 24 19:20:20 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:20:20.987905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817bb5b-8225-4ae2-96f9-025e055dba28 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:21.084947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817bb5b-8225-4ae2-96f9-025e055dba28 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:21.118279 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58198c42-e11d-418a-b4e8-041f586b83a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:21.118900 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58198c42-e11d-418a-b4e8-041f586b83a1 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:21.119184 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58198c42-e11d-418a-b4e8-041f586b83a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:21.119457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58198c42-e11d-418a-b4e8-041f586b83a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:21.120085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58198c42-e11d-418a-b4e8-041f586b83a1 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:21.120392 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58198c42-e11d-418a-b4e8-041f586b83a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:21.121738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58198c42-e11d-418a-b4e8-041f586b83a1 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:21.128730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 581/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Sat Sep 24 19:20:20 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:20:23.230656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c0989-da17-4b0e-a52a-c184c7629a19 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:23.231217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c0989-da17-4b0e-a52a-c184c7629a19 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:23.231217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c0989-da17-4b0e-a52a-c184c7629a19 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:23.232550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 586/1167] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:23.237802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37df2a-c8da-457a-90d9-506526826cfa None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:23.238211 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37df2a-c8da-457a-90d9-506526826cfa None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:23.238379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37df2a-c8da-457a-90d9-506526826cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:23.258366 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-5f37df2a-c8da-457a-90d9-506526826cfa None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:23.259567 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-5f37df2a-c8da-457a-90d9-506526826cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:23.288370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:23.326950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 582/1168] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:20:23.595380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c0989-da17-4b0e-a52a-c184c7629a19 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:23.694888 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c0989-da17-4b0e-a52a-c184c7629a19 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:23.696354 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:23.728919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1394f-a694-4da3-b539-f836ccfeb494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:23.729509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1394f-a694-4da3-b539-f836ccfeb494 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:23.729786 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1394f-a694-4da3-b539-f836ccfeb494 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:23.730054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1394f-a694-4da3-b539-f836ccfeb494 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:23.730710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1394f-a694-4da3-b539-f836ccfeb494 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:23.732089 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1394f-a694-4da3-b539-f836ccfeb494 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:23.748912 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 587/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Sat Sep 24 19:20:23 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:20:25.932085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c9125-eb14-46a1-8974-476c4079888f None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:25.932637 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c9125-eb14-46a1-8974-476c4079888f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:25.932637 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c9125-eb14-46a1-8974-476c4079888f None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:25.933942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 583/1170] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:25.939528 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cae38-be05-4b4e-88c5-0f07b10a9d87 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:25.939947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cae38-be05-4b4e-88c5-0f07b10a9d87 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:25.940073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cae38-be05-4b4e-88c5-0f07b10a9d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:25.958171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-581cae38-be05-4b4e-88c5-0f07b10a9d87 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:25.959736 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-581cae38-be05-4b4e-88c5-0f07b10a9d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:26.024980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 588/1171] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:20:26.293622 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c9125-eb14-46a1-8974-476c4079888f None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:26.395836 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c9125-eb14-46a1-8974-476c4079888f None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:26.429662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353cd96-76aa-46ba-9d3a-75664547e2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:26.430343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353cd96-76aa-46ba-9d3a-75664547e2ad None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:26.430624 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353cd96-76aa-46ba-9d3a-75664547e2ad None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:26.430930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353cd96-76aa-46ba-9d3a-75664547e2ad None admin] PATH_INFO: `/v3/domains/19fed5c9e53b4937bcbda77a0df7471c` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:26.441015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353cd96-76aa-46ba-9d3a-75664547e2ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=19fed5c9e53b4937bcbda77a0df7471c)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:26.442433 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353cd96-76aa-46ba-9d3a-75664547e2ad None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:26.444546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 584/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Sat Sep 24 19:20:26 2022] GET /identity/v3/domains/19fed5c9e53b4937bcbda77a0df7471c => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:26.450329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cae38-be05-4b4e-88c5-0f07b10a9d87 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:26.538692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:26.548065 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cae38-be05-4b4e-88c5-0f07b10a9d87 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:26.580372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d35f65-81a4-4a17-a379-6c47aad81710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:26.580961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d35f65-81a4-4a17-a379-6c47aad81710 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:26.581236 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d35f65-81a4-4a17-a379-6c47aad81710 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:26.581506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d35f65-81a4-4a17-a379-6c47aad81710 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:26.582147 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d35f65-81a4-4a17-a379-6c47aad81710 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:26.583588 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d35f65-81a4-4a17-a379-6c47aad81710 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:26.609429 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 589/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Sat Sep 24 19:20:26 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:20:28.776046 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566af46a-9d44-4ea5-a9d6-5ce1befc31db None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:28.776566 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566af46a-9d44-4ea5-a9d6-5ce1befc31db None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:28.776679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566af46a-9d44-4ea5-a9d6-5ce1befc31db None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:28.777936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 585/1174] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:28.783219 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38304e41-6be2-4174-813c-a030cc812642 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:28.783621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38304e41-6be2-4174-813c-a030cc812642 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:28.783788 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38304e41-6be2-4174-813c-a030cc812642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:28.802006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-38304e41-6be2-4174-813c-a030cc812642 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:28.804064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-38304e41-6be2-4174-813c-a030cc812642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:28.867626 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 590/1175] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:20:29.137061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566af46a-9d44-4ea5-a9d6-5ce1befc31db None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:29.166504 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:29.238703 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566af46a-9d44-4ea5-a9d6-5ce1befc31db None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:29.270961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae380730-8ee2-4401-9464-581cbae3b904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:29.272207 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae380730-8ee2-4401-9464-581cbae3b904 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:29.272540 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae380730-8ee2-4401-9464-581cbae3b904 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:29.272812 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae380730-8ee2-4401-9464-581cbae3b904 None admin] PATH_INFO: `/v3/domains/19fed5c9e53b4937bcbda77a0df7471c` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:29.273937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae380730-8ee2-4401-9464-581cbae3b904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=19fed5c9e53b4937bcbda77a0df7471c)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:29.275627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae380730-8ee2-4401-9464-581cbae3b904 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:29.277171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 586/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Sat Sep 24 19:20:29 2022] GET /identity/v3/domains/19fed5c9e53b4937bcbda77a0df7471c => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:29.282886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38304e41-6be2-4174-813c-a030cc812642 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:29.354389 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:29.378590 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38304e41-6be2-4174-813c-a030cc812642 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:29.412483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab08d97-6cd8-4943-8743-b0a401f87df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:29.413048 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab08d97-6cd8-4943-8743-b0a401f87df2 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:29.413326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab08d97-6cd8-4943-8743-b0a401f87df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:29.413596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab08d97-6cd8-4943-8743-b0a401f87df2 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:29.414251 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab08d97-6cd8-4943-8743-b0a401f87df2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:29.415704 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab08d97-6cd8-4943-8743-b0a401f87df2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:29.436752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 591/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Sat Sep 24 19:20:29 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:20:31.626218 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fe25a-98d0-47e0-9eb9-357c367140ee None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:31.626773 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fe25a-98d0-47e0-9eb9-357c367140ee None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:31.626773 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fe25a-98d0-47e0-9eb9-357c367140ee None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:31.628136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 587/1178] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:31.634206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e41fb9-119c-4b85-90cb-0c6b04391fd6 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:31.634639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e41fb9-119c-4b85-90cb-0c6b04391fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:31.634760 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e41fb9-119c-4b85-90cb-0c6b04391fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:31.652684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-a3e41fb9-119c-4b85-90cb-0c6b04391fd6 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:31.653853 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a3e41fb9-119c-4b85-90cb-0c6b04391fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:31.717723 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 592/1179] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:20:31.985793 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fe25a-98d0-47e0-9eb9-357c367140ee None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:32.090074 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:32.097913 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fe25a-98d0-47e0-9eb9-357c367140ee None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:32.143219 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47756f-14b2-4f0f-bc93-40e39ab23b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:32.143840 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47756f-14b2-4f0f-bc93-40e39ab23b6f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:32.144115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47756f-14b2-4f0f-bc93-40e39ab23b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:32.144383 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47756f-14b2-4f0f-bc93-40e39ab23b6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:32.155631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47756f-14b2-4f0f-bc93-40e39ab23b6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:20:32.160408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-4d47756f-14b2-4f0f-bc93-40e39ab23b6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:32.160408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:32.160408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:32.160408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:32.160408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:32.160408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:32.160408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:32.160408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:32.160408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:32.160408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:32.160408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:32.160408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:32.160408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:20:32.160408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:20:32.160408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:20:32.160408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:20:32.161532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:20:32.161532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:20:32.161532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:20:32.161532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:20:32.161532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:32.161532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:32.161532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:32.161532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:32.161532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:32.161532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:32.161532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:32.161532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:32.161532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:32.161532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:32.161532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:32.161532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:32.163139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:32.163139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:32.163139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:32.163139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:32.163139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:20:32.163139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:20:32.163139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:20:32.163139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:20:32.163139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:20:32.163139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:20:32.163139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:32.163139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:20:32.166995 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 588/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:20:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:20:32.168201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e41fb9-119c-4b85-90cb-0c6b04391fd6 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:32.225477 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:32.264845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e41fb9-119c-4b85-90cb-0c6b04391fd6 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:32.298326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db5512-e185-4d15-b5cd-e7e8d6ccf287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:32.298953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db5512-e185-4d15-b5cd-e7e8d6ccf287 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:32.299235 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db5512-e185-4d15-b5cd-e7e8d6ccf287 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:32.299504 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db5512-e185-4d15-b5cd-e7e8d6ccf287 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:32.300150 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db5512-e185-4d15-b5cd-e7e8d6ccf287 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:32.300451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db5512-e185-4d15-b5cd-e7e8d6ccf287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:32.301803 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db5512-e185-4d15-b5cd-e7e8d6ccf287 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:32.309754 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 593/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:20:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:32.315798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47756f-14b2-4f0f-bc93-40e39ab23b6f None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:32.412873 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47756f-14b2-4f0f-bc93-40e39ab23b6f None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:32.446215 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46d651-30cd-4ca7-a085-dcb7c2e74a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:32.446868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46d651-30cd-4ca7-a085-dcb7c2e74a84 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:32.447142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46d651-30cd-4ca7-a085-dcb7c2e74a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:32.447413 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46d651-30cd-4ca7-a085-dcb7c2e74a84 None admin] PATH_INFO: `/v3/users/e22fa13b2dc248c3b36be835a4cf764f` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:32.461050 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46d651-30cd-4ca7-a085-dcb7c2e74a84 None admin] RBAC: Authorizing `identity:get_user(user_id=e22fa13b2dc248c3b36be835a4cf764f)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:32.462477 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f46d651-30cd-4ca7-a085-dcb7c2e74a84 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:32.464096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 589/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:32 2022] GET /identity/v3/users/e22fa13b2dc248c3b36be835a4cf764f => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:32.469917 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db5512-e185-4d15-b5cd-e7e8d6ccf287 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:32.567304 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db5512-e185-4d15-b5cd-e7e8d6ccf287 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:32.589816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:32.601409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47600f63-3cad-4905-8cd1-0dd68bfeb61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:32.602011 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47600f63-3cad-4905-8cd1-0dd68bfeb61e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:32.602288 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47600f63-3cad-4905-8cd1-0dd68bfeb61e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:32.602558 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47600f63-3cad-4905-8cd1-0dd68bfeb61e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:32.666753 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47600f63-3cad-4905-8cd1-0dd68bfeb61e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:32.668206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47600f63-3cad-4905-8cd1-0dd68bfeb61e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:32.762493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 594/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:20:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:20:32.768510 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46d651-30cd-4ca7-a085-dcb7c2e74a84 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:32.785554 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:32.875310 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46d651-30cd-4ca7-a085-dcb7c2e74a84 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:32.911465 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36137bb2-00a4-489a-8344-6e05c4487814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:32.912297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36137bb2-00a4-489a-8344-6e05c4487814 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:32.912583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36137bb2-00a4-489a-8344-6e05c4487814 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:32.912845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36137bb2-00a4-489a-8344-6e05c4487814 None admin] PATH_INFO: `/v3/projects/a7ad02f39b9f46aabfb1a99ad2ec0d57` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:32.913945 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36137bb2-00a4-489a-8344-6e05c4487814 None admin] RBAC: Authorizing `identity:get_project(project_id=a7ad02f39b9f46aabfb1a99ad2ec0d57)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:32.915406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36137bb2-00a4-489a-8344-6e05c4487814 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:32.917024 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 590/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:20:32 2022] GET /identity/v3/projects/a7ad02f39b9f46aabfb1a99ad2ec0d57 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:32.923254 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47600f63-3cad-4905-8cd1-0dd68bfeb61e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:32.950350 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:33.026029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47600f63-3cad-4905-8cd1-0dd68bfeb61e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:33.059141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eefd26-7174-4618-aa29-617aa45b6512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:33.059731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eefd26-7174-4618-aa29-617aa45b6512 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:33.060003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eefd26-7174-4618-aa29-617aa45b6512 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:33.060269 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eefd26-7174-4618-aa29-617aa45b6512 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:33.060976 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eefd26-7174-4618-aa29-617aa45b6512 None admin] RBAC: Adding query filter params (role.id=dd27845a836a4f6ebece149dbebc59c0, scope.project.id=a7ad02f39b9f46aabfb1a99ad2ec0d57, user.id=e22fa13b2dc248c3b36be835a4cf764f) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:33.061276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eefd26-7174-4618-aa29-617aa45b6512 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:33.062676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eefd26-7174-4618-aa29-617aa45b6512 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:33.067856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 595/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:20:32 2022] GET /identity/v3/role_assignments?user.id=e22fa13b2dc248c3b36be835a4cf764f&scope.project.id=a7ad02f39b9f46aabfb1a99ad2ec0d57&role.id=dd27845a836a4f6ebece149dbebc59c0 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:35.181476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aeb1d-233c-4efe-9b9b-07e2e48fde45 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:35.182075 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aeb1d-233c-4efe-9b9b-07e2e48fde45 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:35.182075 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aeb1d-233c-4efe-9b9b-07e2e48fde45 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:35.183394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 591/1186] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:35.188442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45296d-828f-47bd-a16f-533a985239ce None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:35.188847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45296d-828f-47bd-a16f-533a985239ce None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:35.188996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45296d-828f-47bd-a16f-533a985239ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:35.207408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-8a45296d-828f-47bd-a16f-533a985239ce None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:35.208598 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-8a45296d-828f-47bd-a16f-533a985239ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:35.273269 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 596/1187] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:20:35.543138 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493aeb1d-233c-4efe-9b9b-07e2e48fde45 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:35.623830 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:35.642376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493aeb1d-233c-4efe-9b9b-07e2e48fde45 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:35.675621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ac2ae-807d-44db-860b-d83c78a70b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:35.676235 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ac2ae-807d-44db-860b-d83c78a70b14 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:35.676512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ac2ae-807d-44db-860b-d83c78a70b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:35.676778 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ac2ae-807d-44db-860b-d83c78a70b14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:35.686974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ac2ae-807d-44db-860b-d83c78a70b14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:20:35.691740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-028ac2ae-807d-44db-860b-d83c78a70b14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:35.691740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:35.691740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:35.691740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:35.691740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:35.691740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:35.691740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:35.691740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:35.691740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:35.691740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:35.691740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:35.691740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:35.691740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:20:35.691740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:20:35.691740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:20:35.691740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:20:35.692834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:20:35.692834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:20:35.692834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:20:35.692834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:20:35.692834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:35.692834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:35.692834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:35.692834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:35.692834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:35.692834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:35.692834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:35.692834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:35.692834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:35.692834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:35.692834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:35.692834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:35.694454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:35.694454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:35.694454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:35.694454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:35.694454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:20:35.694454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:20:35.694454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:20:35.694454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:20:35.694454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:20:35.694454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:20:35.694454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:35.694454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:20:35.694454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 592/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:20:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:20:35.699531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45296d-828f-47bd-a16f-533a985239ce None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:35.717177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:35.795487 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45296d-828f-47bd-a16f-533a985239ce None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:35.827944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ecab8-c500-4f5c-93b6-d9645e4e7173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:35.828535 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ecab8-c500-4f5c-93b6-d9645e4e7173 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:35.828806 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ecab8-c500-4f5c-93b6-d9645e4e7173 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:35.829069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ecab8-c500-4f5c-93b6-d9645e4e7173 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:35.829703 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ecab8-c500-4f5c-93b6-d9645e4e7173 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:35.830033 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ecab8-c500-4f5c-93b6-d9645e4e7173 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:35.831420 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ecab8-c500-4f5c-93b6-d9645e4e7173 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:35.839146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 597/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:20:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:35.844849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ac2ae-807d-44db-860b-d83c78a70b14 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:35.942004 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ac2ae-807d-44db-860b-d83c78a70b14 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:35.974388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee717f69-3a32-4bbc-b32e-9e0de20b086b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:35.975249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee717f69-3a32-4bbc-b32e-9e0de20b086b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:35.975519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee717f69-3a32-4bbc-b32e-9e0de20b086b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:35.975783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee717f69-3a32-4bbc-b32e-9e0de20b086b None admin] PATH_INFO: `/v3/users/e22fa13b2dc248c3b36be835a4cf764f` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:35.976881 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee717f69-3a32-4bbc-b32e-9e0de20b086b None admin] RBAC: Authorizing `identity:get_user(user_id=e22fa13b2dc248c3b36be835a4cf764f)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:35.978276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee717f69-3a32-4bbc-b32e-9e0de20b086b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:35.979837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 593/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:35 2022] GET /identity/v3/users/e22fa13b2dc248c3b36be835a4cf764f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:35.985455 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ecab8-c500-4f5c-93b6-d9645e4e7173 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:36.063299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:36.084924 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ecab8-c500-4f5c-93b6-d9645e4e7173 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:36.117678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d22e8f-4dcf-4d49-bd19-03b8982907e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:36.118280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d22e8f-4dcf-4d49-bd19-03b8982907e3 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:36.118554 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d22e8f-4dcf-4d49-bd19-03b8982907e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:36.118819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d22e8f-4dcf-4d49-bd19-03b8982907e3 None admin] PATH_INFO: `/v3/projects/a7ad02f39b9f46aabfb1a99ad2ec0d57` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:36.119932 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d22e8f-4dcf-4d49-bd19-03b8982907e3 None admin] RBAC: Authorizing `identity:get_project(project_id=a7ad02f39b9f46aabfb1a99ad2ec0d57)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:36.121342 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d22e8f-4dcf-4d49-bd19-03b8982907e3 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:36.122964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 598/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:20:35 2022] GET /identity/v3/projects/a7ad02f39b9f46aabfb1a99ad2ec0d57 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:36.128898 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee717f69-3a32-4bbc-b32e-9e0de20b086b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:36.141383 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:36.227299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee717f69-3a32-4bbc-b32e-9e0de20b086b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:36.260295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02025d6-2a4d-4616-a08f-a5c7f814c09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:36.260930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02025d6-2a4d-4616-a08f-a5c7f814c09b None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:36.261214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02025d6-2a4d-4616-a08f-a5c7f814c09b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:36.261514 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02025d6-2a4d-4616-a08f-a5c7f814c09b None admin] PATH_INFO: `/v3/projects/a7ad02f39b9f46aabfb1a99ad2ec0d57/users/e22fa13b2dc248c3b36be835a4cf764f/roles/dd27845a836a4f6ebece149dbebc59c0` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:36.263392 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02025d6-2a4d-4616-a08f-a5c7f814c09b None admin] RBAC: Authorizing `identity:create_grant(project_id=a7ad02f39b9f46aabfb1a99ad2ec0d57, user_id=e22fa13b2dc248c3b36be835a4cf764f, role_id=dd27845a836a4f6ebece149dbebc59c0)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:36.264804 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02025d6-2a4d-4616-a08f-a5c7f814c09b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:36.277024 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 594/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:20:36 2022] PUT /identity/v3/projects/a7ad02f39b9f46aabfb1a99ad2ec0d57/users/e22fa13b2dc248c3b36be835a4cf764f/roles/dd27845a836a4f6ebece149dbebc59c0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:20:38.402217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e24cd3-c277-40dc-887f-3f9182767d4e None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:38.402774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e24cd3-c277-40dc-887f-3f9182767d4e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:38.402774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e24cd3-c277-40dc-887f-3f9182767d4e None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:38.404099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 599/1193] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:38.409535 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9c646-7172-42b4-9beb-1d8359182e77 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:38.409940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9c646-7172-42b4-9beb-1d8359182e77 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:38.410079 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9c646-7172-42b4-9beb-1d8359182e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:38.428041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-5fb9c646-7172-42b4-9beb-1d8359182e77 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:38.429214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-5fb9c646-7172-42b4-9beb-1d8359182e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:38.489562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:38.494792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 595/1194] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:20:38.769137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e24cd3-c277-40dc-887f-3f9182767d4e None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:38.867275 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e24cd3-c277-40dc-887f-3f9182767d4e None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:38.900216 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e226ac-6f15-431b-ae21-559c67a36c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:38.900829 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e226ac-6f15-431b-ae21-559c67a36c01 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:38.901106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e226ac-6f15-431b-ae21-559c67a36c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:38.901376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e226ac-6f15-431b-ae21-559c67a36c01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:38.911052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e226ac-6f15-431b-ae21-559c67a36c01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:20:38.916022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-89e226ac-6f15-431b-ae21-559c67a36c01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:38.916022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:38.916022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:38.916022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:38.916022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:38.916022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:38.916022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:38.916022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:38.916022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:38.916022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:38.916022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:38.916022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:38.916022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:20:38.916022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:20:38.916022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:20:38.916022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:20:38.917097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:20:38.917097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:20:38.917097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:20:38.917097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:20:38.917097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:38.917097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:38.917097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:38.917097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:38.917097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:38.917097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:38.917097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:38.917097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:38.917097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:38.917097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:38.917097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:38.917097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:38.918139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:38.918139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:38.918139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:38.918139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:38.918139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:20:38.918139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:20:38.918139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:20:38.918139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:20:38.918139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:20:38.918139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:20:38.918139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:38.918139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:20:38.918139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 600/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:20:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:20:38.923282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9c646-7172-42b4-9beb-1d8359182e77 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:39.021403 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9c646-7172-42b4-9beb-1d8359182e77 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:39.056333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcafbf8-cfc7-4c52-ad6e-f70d74cb30b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:39.056929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcafbf8-cfc7-4c52-ad6e-f70d74cb30b4 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:39.057208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcafbf8-cfc7-4c52-ad6e-f70d74cb30b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:39.057482 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcafbf8-cfc7-4c52-ad6e-f70d74cb30b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:39.058137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcafbf8-cfc7-4c52-ad6e-f70d74cb30b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:39.058439 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcafbf8-cfc7-4c52-ad6e-f70d74cb30b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:39.059818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcafbf8-cfc7-4c52-ad6e-f70d74cb30b4 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:39.067671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 596/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:20:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:39.074346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e226ac-6f15-431b-ae21-559c67a36c01 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:39.083668 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:39.171017 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e226ac-6f15-431b-ae21-559c67a36c01 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:39.203826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e4081-5a82-4784-922a-fa67dd3a46b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:39.204436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e4081-5a82-4784-922a-fa67dd3a46b7 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:39.204712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e4081-5a82-4784-922a-fa67dd3a46b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:39.204980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e4081-5a82-4784-922a-fa67dd3a46b7 None admin] PATH_INFO: `/v3/users/e22fa13b2dc248c3b36be835a4cf764f` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:39.206075 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e4081-5a82-4784-922a-fa67dd3a46b7 None admin] RBAC: Authorizing `identity:get_user(user_id=e22fa13b2dc248c3b36be835a4cf764f)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:39.207516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e4081-5a82-4784-922a-fa67dd3a46b7 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:39.209059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 601/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:39 2022] GET /identity/v3/users/e22fa13b2dc248c3b36be835a4cf764f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:39.214740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcafbf8-cfc7-4c52-ad6e-f70d74cb30b4 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:39.275221 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:39.314481 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcafbf8-cfc7-4c52-ad6e-f70d74cb30b4 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:39.347242 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb2360-4ab0-4284-a5e9-71cf099c5bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:39.347839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb2360-4ab0-4284-a5e9-71cf099c5bea None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:39.348116 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb2360-4ab0-4284-a5e9-71cf099c5bea None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:39.348386 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb2360-4ab0-4284-a5e9-71cf099c5bea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:39.414409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb2360-4ab0-4284-a5e9-71cf099c5bea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:39.415890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb2360-4ab0-4284-a5e9-71cf099c5bea None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:39.473069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:39.511976 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 597/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:20:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:20:39.517902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e4081-5a82-4784-922a-fa67dd3a46b7 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:39.591573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:39.615764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e4081-5a82-4784-922a-fa67dd3a46b7 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:39.648703 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe381c-9f16-40e0-b9d4-c88e2064d73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:39.649567 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe381c-9f16-40e0-b9d4-c88e2064d73a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:39.649845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe381c-9f16-40e0-b9d4-c88e2064d73a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:39.650124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe381c-9f16-40e0-b9d4-c88e2064d73a None admin] PATH_INFO: `/v3/projects/a7ad02f39b9f46aabfb1a99ad2ec0d57` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:39.651264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe381c-9f16-40e0-b9d4-c88e2064d73a None admin] RBAC: Authorizing `identity:get_project(project_id=a7ad02f39b9f46aabfb1a99ad2ec0d57)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:39.652687 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe381c-9f16-40e0-b9d4-c88e2064d73a None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:39.654292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 602/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Sat Sep 24 19:20:39 2022] GET /identity/v3/projects/a7ad02f39b9f46aabfb1a99ad2ec0d57 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:39.660432 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb2360-4ab0-4284-a5e9-71cf099c5bea None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:39.754963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb2360-4ab0-4284-a5e9-71cf099c5bea None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:39.788392 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4d4ac-03ab-4397-b800-609732f71e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:39.788974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4d4ac-03ab-4397-b800-609732f71e40 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:39.789251 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4d4ac-03ab-4397-b800-609732f71e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:39.789523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4d4ac-03ab-4397-b800-609732f71e40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:39.790233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4d4ac-03ab-4397-b800-609732f71e40 None admin] RBAC: Adding query filter params (role.id=dd27845a836a4f6ebece149dbebc59c0, scope.project.id=a7ad02f39b9f46aabfb1a99ad2ec0d57, user.id=e22fa13b2dc248c3b36be835a4cf764f) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:39.790540 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4d4ac-03ab-4397-b800-609732f71e40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:39.791978 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4d4ac-03ab-4397-b800-609732f71e40 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:39.797478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 598/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:20:39 2022] GET /identity/v3/role_assignments?user.id=e22fa13b2dc248c3b36be835a4cf764f&scope.project.id=a7ad02f39b9f46aabfb1a99ad2ec0d57&role.id=dd27845a836a4f6ebece149dbebc59c0 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:49.643823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=29 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:49.795004 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=87 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:36.167489 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75adb207-bb7b-444e-9c19-f5ea90df9228 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:36.168143 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75adb207-bb7b-444e-9c19-f5ea90df9228 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:36.168143 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75adb207-bb7b-444e-9c19-f5ea90df9228 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:36.169558 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 603/1201] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:36.178641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca189bb-e04b-4670-a0f3-9d623b791434 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:36.178641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca189bb-e04b-4670-a0f3-9d623b791434 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:36.178641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca189bb-e04b-4670-a0f3-9d623b791434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:36.205419 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-6ca189bb-e04b-4670-a0f3-9d623b791434 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:36.207060 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6ca189bb-e04b-4670-a0f3-9d623b791434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:36.289815 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 599/1202] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:21:36.570264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75adb207-bb7b-444e-9c19-f5ea90df9228 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:36.696247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75adb207-bb7b-444e-9c19-f5ea90df9228 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:36.733983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff338ddf-e681-4cf5-93c2-d18749ec8c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:36.734632 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff338ddf-e681-4cf5-93c2-d18749ec8c4c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:36.734925 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff338ddf-e681-4cf5-93c2-d18749ec8c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:36.735200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff338ddf-e681-4cf5-93c2-d18749ec8c4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:36.747173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff338ddf-e681-4cf5-93c2-d18749ec8c4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:36.748632 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff338ddf-e681-4cf5-93c2-d18749ec8c4c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:36.766372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-ff338ddf-e681-4cf5-93c2-d18749ec8c4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:36.766372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:36.766372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:36.766372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:36.766372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:36.766372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:36.766372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:36.766372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:36.766372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:36.766372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:36.766372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:36.766372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:36.766372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:21:36.766372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:21:36.766372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:21:36.766372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:21:36.767851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:36.767851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:36.767851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:36.767851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:36.767851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:36.767851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:36.767851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:36.767851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:36.767851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:36.767851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:36.767851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:36.767851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:36.767851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:36.767851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:36.767851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:36.767851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:36.767851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:21:36.768864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:21:36.768864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:36.768864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:21:36.768864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 604/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:21:36.776482 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca189bb-e04b-4670-a0f3-9d623b791434 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:36.913167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca189bb-e04b-4670-a0f3-9d623b791434 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:36.947603 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:36.954999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a393ee9-6298-4a77-8a88-3fbbb3e96e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:36.955916 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a393ee9-6298-4a77-8a88-3fbbb3e96e51 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:36.956482 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a393ee9-6298-4a77-8a88-3fbbb3e96e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:36.956828 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a393ee9-6298-4a77-8a88-3fbbb3e96e51 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:36.958133 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a393ee9-6298-4a77-8a88-3fbbb3e96e51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:36.958534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a393ee9-6298-4a77-8a88-3fbbb3e96e51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:36.960563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a393ee9-6298-4a77-8a88-3fbbb3e96e51 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:36.980795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 600/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:36.982082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff338ddf-e681-4cf5-93c2-d18749ec8c4c None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:37.051361 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:37.116257 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff338ddf-e681-4cf5-93c2-d18749ec8c4c None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:37.162945 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7af79-22ba-4b75-bb7b-ae9f93fbc47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:37.163625 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7af79-22ba-4b75-bb7b-ae9f93fbc47d None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:37.163901 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7af79-22ba-4b75-bb7b-ae9f93fbc47d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:37.164216 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7af79-22ba-4b75-bb7b-ae9f93fbc47d None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:37.164827 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7af79-22ba-4b75-bb7b-ae9f93fbc47d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:37.166392 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7af79-22ba-4b75-bb7b-ae9f93fbc47d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:37.203063 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 605/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Sat Sep 24 19:21:36 2022] POST /identity/v3/users => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:21:39.606879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07885f-e070-41b0-a139-292913f36a24 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:39.606879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07885f-e070-41b0-a139-292913f36a24 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:39.606879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07885f-e070-41b0-a139-292913f36a24 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:39.608223 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 601/1206] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:39.614465 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6259de-bc7e-4917-82e3-1da144c77a25 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:39.614964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6259de-bc7e-4917-82e3-1da144c77a25 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:39.615056 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6259de-bc7e-4917-82e3-1da144c77a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:39.635162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-1a6259de-bc7e-4917-82e3-1da144c77a25 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:39.636353 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1a6259de-bc7e-4917-82e3-1da144c77a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:39.713794 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 606/1207] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:21:39.985731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07885f-e070-41b0-a139-292913f36a24 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:40.104244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07885f-e070-41b0-a139-292913f36a24 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:40.149589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f0e41-f769-46b5-9517-3ccfeeebf2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:40.150919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f0e41-f769-46b5-9517-3ccfeeebf2ab None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:40.150919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f0e41-f769-46b5-9517-3ccfeeebf2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:40.151203 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f0e41-f769-46b5-9517-3ccfeeebf2ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:40.163046 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f0e41-f769-46b5-9517-3ccfeeebf2ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:40.167911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-eb6f0e41-f769-46b5-9517-3ccfeeebf2ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:21:40.167911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:40.167911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:40.167911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:40.167911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:40.167911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:40.167911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:40.167911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:40.167911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:40.167911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:40.167911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:40.167911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:40.167911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:40.167911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:40.167911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:40.167911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:40.169091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:40.169091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:40.169091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:40.169091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:40.169091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:40.169091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:40.169091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:40.169091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:40.169091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:40.169091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:40.169091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:40.169091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:40.169091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:40.169091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:40.169091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:40.169091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:40.170273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:40.170273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:40.170273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:40.170273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:40.170273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:40.170273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:40.170273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:40.170273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:40.170273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:40.170273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:40.170273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:21:40.170273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:21:40.170273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 602/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:21:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:40.175155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6259de-bc7e-4917-82e3-1da144c77a25 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:40.223006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:40.310795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6259de-bc7e-4917-82e3-1da144c77a25 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:40.346743 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4eb03-b67f-4afc-baa2-a19843ee21dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:40.347999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4eb03-b67f-4afc-baa2-a19843ee21dd None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:40.348264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4eb03-b67f-4afc-baa2-a19843ee21dd None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:40.348491 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4eb03-b67f-4afc-baa2-a19843ee21dd None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:40.349144 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4eb03-b67f-4afc-baa2-a19843ee21dd None admin] RBAC: Adding query filter params (name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:40.349447 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4eb03-b67f-4afc-baa2-a19843ee21dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:40.350849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4eb03-b67f-4afc-baa2-a19843ee21dd None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:40.359444 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 607/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Sat Sep 24 19:21:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:40.365133 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f0e41-f769-46b5-9517-3ccfeeebf2ab None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:40.427507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:40.486078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f0e41-f769-46b5-9517-3ccfeeebf2ab None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:40.527156 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255e212-931a-4909-8f03-bc6c7bce72fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:40.527798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255e212-931a-4909-8f03-bc6c7bce72fa None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:40.528076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255e212-931a-4909-8f03-bc6c7bce72fa None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:40.528348 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255e212-931a-4909-8f03-bc6c7bce72fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:40.540499 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255e212-931a-4909-8f03-bc6c7bce72fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:40.541983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255e212-931a-4909-8f03-bc6c7bce72fa None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:40.557292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-7255e212-931a-4909-8f03-bc6c7bce72fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:40.557292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:40.557292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:40.557292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:40.557292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:40.557292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:40.557292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:40.557292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:40.557292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:40.557292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:40.557292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:40.557292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:40.557292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:21:40.557292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:21:40.557292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:21:40.557292 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:21:40.558346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:40.558346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:40.558346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:40.558346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:40.558346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:40.558346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:40.558346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:40.558346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:40.558346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:40.558346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:40.558346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:40.558346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:40.558346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:40.558346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:40.558346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:40.558346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:40.558346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:21:40.559951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:21:40.559951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:40.559951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:21:40.559951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 603/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:40.564203 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4eb03-b67f-4afc-baa2-a19843ee21dd None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:40.669962 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:40.674195 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4eb03-b67f-4afc-baa2-a19843ee21dd None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:40.716282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505b377-914b-4abb-881c-18d7ba69d623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:40.716922 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505b377-914b-4abb-881c-18d7ba69d623 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:40.717203 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505b377-914b-4abb-881c-18d7ba69d623 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:40.717475 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505b377-914b-4abb-881c-18d7ba69d623 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:40.718108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505b377-914b-4abb-881c-18d7ba69d623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:40.718410 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505b377-914b-4abb-881c-18d7ba69d623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:40.720038 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505b377-914b-4abb-881c-18d7ba69d623 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:40.733125 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 608/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:40.739859 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255e212-931a-4909-8f03-bc6c7bce72fa None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:40.855638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255e212-931a-4909-8f03-bc6c7bce72fa None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:40.857252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:40.891426 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91dbeda-7d69-4442-bcea-91384ac7481c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:40.892048 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dbeda-7d69-4442-bcea-91384ac7481c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:40.892323 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dbeda-7d69-4442-bcea-91384ac7481c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:40.892591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dbeda-7d69-4442-bcea-91384ac7481c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:40.901139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91dbeda-7d69-4442-bcea-91384ac7481c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:40.902646 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91dbeda-7d69-4442-bcea-91384ac7481c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:40.914333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-c91dbeda-7d69-4442-bcea-91384ac7481c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:21:40.914333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:40.914333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:40.914333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:40.914333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:40.914333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:40.914333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:40.914333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:40.914333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:40.914333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:40.914333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:40.914333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:40.914333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:21:40.914333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:21:40.914333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:21:40.914333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:21:40.915737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:40.915737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:40.915737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:21:40.915737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:21:40.915737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:21:40.915737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:21:40.915737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:40.915737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:40.915737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:40.915737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:40.915737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:40.915737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:40.915737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:40.915737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:40.915737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:40.915737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:40.915737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:40.915737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:40.916929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:40.916929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:40.916929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:21:40.916929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:21:40.916929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:21:40.916929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:21:40.916929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:21:40.916929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:21:40.916929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:21:40.916929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:21:40.920614 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 604/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:40.921512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505b377-914b-4abb-881c-18d7ba69d623 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:41.031785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505b377-914b-4abb-881c-18d7ba69d623 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:41.067290 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd1619-dcfb-44e6-ba13-7476ca3232eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:41.067882 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd1619-dcfb-44e6-ba13-7476ca3232eb None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:41.068155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd1619-dcfb-44e6-ba13-7476ca3232eb None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:41.068476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd1619-dcfb-44e6-ba13-7476ca3232eb None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:41.069198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd1619-dcfb-44e6-ba13-7476ca3232eb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:41.069500 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd1619-dcfb-44e6-ba13-7476ca3232eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:41.071052 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd1619-dcfb-44e6-ba13-7476ca3232eb None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:41.097424 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 609/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Sat Sep 24 19:21:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:21:41.098803 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91dbeda-7d69-4442-bcea-91384ac7481c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:41.213230 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91dbeda-7d69-4442-bcea-91384ac7481c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:41.249459 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48e982-48f6-4cc2-bac1-2816ce664ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:41.250074 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48e982-48f6-4cc2-bac1-2816ce664ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:41.250351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48e982-48f6-4cc2-bac1-2816ce664ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:41.250637 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48e982-48f6-4cc2-bac1-2816ce664ef4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:41.282319 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:41.328794 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48e982-48f6-4cc2-bac1-2816ce664ef4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:41.330621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48e982-48f6-4cc2-bac1-2816ce664ef4 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:41.467691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 605/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:21:41.474486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd1619-dcfb-44e6-ba13-7476ca3232eb None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:41.499312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:41.598905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd1619-dcfb-44e6-ba13-7476ca3232eb None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:41.644782 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f5013-e3ca-4a56-b6ca-4f84e7128756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:41.645424 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f5013-e3ca-4a56-b6ca-4f84e7128756 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:41.645706 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f5013-e3ca-4a56-b6ca-4f84e7128756 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:41.645977 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f5013-e3ca-4a56-b6ca-4f84e7128756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:41.657811 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f5013-e3ca-4a56-b6ca-4f84e7128756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:41.659318 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f5013-e3ca-4a56-b6ca-4f84e7128756 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:41.677026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-b24f5013-e3ca-4a56-b6ca-4f84e7128756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:41.677026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:41.677026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:41.677026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:41.677026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:41.677026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:41.677026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:41.677026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:41.677026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:41.677026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:41.677026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:41.677026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:41.677026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:21:41.677026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:21:41.677026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:21:41.677026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:21:41.678617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:41.678617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:41.678617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:41.678617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:41.678617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:41.678617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:41.678617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:41.678617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:41.678617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:41.678617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:41.678617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:41.678617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:41.678617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:41.678617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:41.678617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:41.678617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:41.678617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:21:41.679631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:21:41.679631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:41.679631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:21:41.679631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 610/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:21:41.684433 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48e982-48f6-4cc2-bac1-2816ce664ef4 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:41.761745 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:41.805133 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48e982-48f6-4cc2-bac1-2816ce664ef4 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:41.841946 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9907a09-4cd8-47fd-9db0-2f6dac45dd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:41.842652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9907a09-4cd8-47fd-9db0-2f6dac45dd93 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:41.842950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9907a09-4cd8-47fd-9db0-2f6dac45dd93 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:41.843245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9907a09-4cd8-47fd-9db0-2f6dac45dd93 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:41.843911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9907a09-4cd8-47fd-9db0-2f6dac45dd93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:41.844190 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9907a09-4cd8-47fd-9db0-2f6dac45dd93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:41.845554 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9907a09-4cd8-47fd-9db0-2f6dac45dd93 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:41.857304 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 606/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:41.864120 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f5013-e3ca-4a56-b6ca-4f84e7128756 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:41.944515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:41.981023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f5013-e3ca-4a56-b6ca-4f84e7128756 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:42.015301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31553f-d856-4e3b-8f3a-da760fe3020d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:42.015851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31553f-d856-4e3b-8f3a-da760fe3020d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:42.016130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31553f-d856-4e3b-8f3a-da760fe3020d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:42.016399 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31553f-d856-4e3b-8f3a-da760fe3020d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:42.023490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31553f-d856-4e3b-8f3a-da760fe3020d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:42.025140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31553f-d856-4e3b-8f3a-da760fe3020d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:42.037057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-1f31553f-d856-4e3b-8f3a-da760fe3020d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:21:42.037057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:42.037057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:42.037057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:42.037057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:42.037057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:42.037057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:42.037057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:42.037057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:42.037057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:42.037057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:42.037057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:42.037057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:21:42.037057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:21:42.037057 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:21:42.038213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:21:42.038213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:42.038213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:42.038213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:42.038213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:42.038213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:42.038213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:42.038213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:42.038213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:42.038213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:42.038213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:42.038213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:42.038213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:42.038213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:42.038213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:42.038213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:42.038213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:42.040096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:21:42.040096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:21:42.040096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:21:42.040096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:21:42.040096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:21:42.040096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:21:42.040096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:21:42.040096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:21:42.040096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 611/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:21:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:42.044241 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9907a09-4cd8-47fd-9db0-2f6dac45dd93 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:42.159279 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9907a09-4cd8-47fd-9db0-2f6dac45dd93 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:42.184055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:42.196963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cb91c-ea9d-4905-9852-71e78f852e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:42.197567 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cb91c-ea9d-4905-9852-71e78f852e9d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:42.197848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cb91c-ea9d-4905-9852-71e78f852e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:42.198324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cb91c-ea9d-4905-9852-71e78f852e9d None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:42.199082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cb91c-ea9d-4905-9852-71e78f852e9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:42.199420 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cb91c-ea9d-4905-9852-71e78f852e9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:42.202641 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cb91c-ea9d-4905-9852-71e78f852e9d None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:42.216871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 607/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:21:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:21:42.223895 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31553f-d856-4e3b-8f3a-da760fe3020d None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:42.335289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31553f-d856-4e3b-8f3a-da760fe3020d None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:42.365910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:42.372204 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b195b-877b-46d2-b63f-e8fb57770ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:42.372808 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b195b-877b-46d2-b63f-e8fb57770ecb None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:42.373086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b195b-877b-46d2-b63f-e8fb57770ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:42.373357 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b195b-877b-46d2-b63f-e8fb57770ecb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:42.374074 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b195b-877b-46d2-b63f-e8fb57770ecb None admin] RBAC: Adding query filter params (role.id=a2673fe5628247c3a918eaa28d483e9f, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=95a375bda898420fb9df08d514bf9bff) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:42.374377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b195b-877b-46d2-b63f-e8fb57770ecb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:42.375848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b195b-877b-46d2-b63f-e8fb57770ecb None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:42.381485 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 612/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:21:42 2022] GET /identity/v3/role_assignments?user.id=95a375bda898420fb9df08d514bf9bff&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=a2673fe5628247c3a918eaa28d483e9f => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:44.599387 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f441c9-13de-4b58-9e3e-acf0bd2fcdb9 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:44.600090 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f441c9-13de-4b58-9e3e-acf0bd2fcdb9 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:44.600090 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f441c9-13de-4b58-9e3e-acf0bd2fcdb9 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:44.601334 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 608/1220] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:44.606694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc03ea-5594-45fd-af90-7b770e64e50f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:44.607138 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc03ea-5594-45fd-af90-7b770e64e50f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:44.607303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc03ea-5594-45fd-af90-7b770e64e50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:44.627472 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-89bc03ea-5594-45fd-af90-7b770e64e50f None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:44.628896 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-89bc03ea-5594-45fd-af90-7b770e64e50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:44.704918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 613/1221] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:21:44.977942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f441c9-13de-4b58-9e3e-acf0bd2fcdb9 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:45.099627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f441c9-13de-4b58-9e3e-acf0bd2fcdb9 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:45.139575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59294da8-6a2f-409f-83db-192a4eb0923d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:45.140219 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59294da8-6a2f-409f-83db-192a4eb0923d None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:45.140500 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59294da8-6a2f-409f-83db-192a4eb0923d None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:45.140809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59294da8-6a2f-409f-83db-192a4eb0923d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:45.153417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59294da8-6a2f-409f-83db-192a4eb0923d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:45.158587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-59294da8-6a2f-409f-83db-192a4eb0923d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:21:45.158587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:45.158587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:45.158587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:45.158587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:45.158587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:45.158587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:45.158587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:45.158587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:45.158587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:45.158587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:45.158587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:45.158587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:45.158587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:45.158587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:45.158587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:45.160591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:45.160591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:45.160591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:45.160591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:45.160591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:45.160591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:45.160591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:45.160591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:45.160591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:45.160591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:45.160591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:45.160591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:45.160591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:45.160591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:45.160591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:45.160591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:45.161869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:45.161869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:45.161869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:45.161869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:45.161869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:45.161869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:45.161869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:45.161869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:45.161869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:45.161869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:45.161869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:21:45.161869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:21:45.161869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 609/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:21:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:21:45.166343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc03ea-5594-45fd-af90-7b770e64e50f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:45.276461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc03ea-5594-45fd-af90-7b770e64e50f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:45.304126 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:45.315697 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00638c94-8110-4ab4-b689-e3a03b827a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:45.316330 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00638c94-8110-4ab4-b689-e3a03b827a1b None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:45.316656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00638c94-8110-4ab4-b689-e3a03b827a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:45.316879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00638c94-8110-4ab4-b689-e3a03b827a1b None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:45.317555 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00638c94-8110-4ab4-b689-e3a03b827a1b None admin] RBAC: Adding query filter params (name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:45.317855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00638c94-8110-4ab4-b689-e3a03b827a1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:45.319282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00638c94-8110-4ab4-b689-e3a03b827a1b None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:45.327338 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 614/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Sat Sep 24 19:21:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:45.333089 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59294da8-6a2f-409f-83db-192a4eb0923d None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:45.379152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:45.442673 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59294da8-6a2f-409f-83db-192a4eb0923d None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:45.482028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e3753-bc13-429a-b209-ec8ab4310ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:45.482677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e3753-bc13-429a-b209-ec8ab4310ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:45.482990 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e3753-bc13-429a-b209-ec8ab4310ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:45.483266 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e3753-bc13-429a-b209-ec8ab4310ad7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:45.494453 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e3753-bc13-429a-b209-ec8ab4310ad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:45.495922 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e3753-bc13-429a-b209-ec8ab4310ad7 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:45.512474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-1e9e3753-bc13-429a-b209-ec8ab4310ad7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:45.512474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:45.512474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:45.512474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:45.512474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:45.512474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:45.512474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:45.512474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:45.512474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:45.512474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:45.512474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:45.512474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:45.512474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:21:45.512474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:21:45.512474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:21:45.512474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:21:45.513799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:45.513799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:45.513799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:45.513799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:45.513799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:45.513799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:45.513799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:45.513799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:45.513799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:45.513799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:45.513799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:45.513799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:45.513799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:45.513799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:45.513799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:45.513799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:45.513799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:21:45.515644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:21:45.515644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:45.515644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:21:45.515644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 610/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:45.521234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00638c94-8110-4ab4-b689-e3a03b827a1b None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:45.634480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00638c94-8110-4ab4-b689-e3a03b827a1b None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:45.674268 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baf277-32dc-472c-bef0-7ff359396aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:45.674892 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baf277-32dc-472c-bef0-7ff359396aad None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:45.675739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baf277-32dc-472c-bef0-7ff359396aad None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:45.676195 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59baf277-32dc-472c-bef0-7ff359396aad None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:45.677198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baf277-32dc-472c-bef0-7ff359396aad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:45.677507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baf277-32dc-472c-bef0-7ff359396aad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:45.679365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59baf277-32dc-472c-bef0-7ff359396aad None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:45.693915 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 615/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:21:45.699682 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e3753-bc13-429a-b209-ec8ab4310ad7 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:45.801493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:45.808858 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e3753-bc13-429a-b209-ec8ab4310ad7 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:45.845951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40f39e-f887-4fa6-988d-29d8d0e9c85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:45.846577 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40f39e-f887-4fa6-988d-29d8d0e9c85c None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:45.847619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40f39e-f887-4fa6-988d-29d8d0e9c85c None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:45.848023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40f39e-f887-4fa6-988d-29d8d0e9c85c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:45.855755 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c40f39e-f887-4fa6-988d-29d8d0e9c85c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:45.857198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c40f39e-f887-4fa6-988d-29d8d0e9c85c None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:45.868751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-6c40f39e-f887-4fa6-988d-29d8d0e9c85c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:21:45.868751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:45.868751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:45.868751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:45.868751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:45.868751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:45.868751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:45.868751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:45.868751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:45.868751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:45.868751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:45.868751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:45.868751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:21:45.868751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:21:45.868751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:21:45.868751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:21:45.870088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:45.870088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:45.870088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:21:45.870088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:21:45.870088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:21:45.870088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:21:45.870088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:45.870088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:45.870088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:45.870088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:45.870088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:45.870088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:45.870088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:45.870088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:45.870088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:45.870088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:45.870088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:45.870088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:45.871406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:45.871406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:45.871406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:21:45.871406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:21:45.871406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:21:45.871406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:21:45.871406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:21:45.871406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:21:45.871406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:21:45.871406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:21:45.871406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 611/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:21:45.875777 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baf277-32dc-472c-bef0-7ff359396aad None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:45.923495 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:45.981194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59baf277-32dc-472c-bef0-7ff359396aad None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:46.022682 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1ef29-5455-4c03-b39b-5dc80fc255ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:46.023466 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1ef29-5455-4c03-b39b-5dc80fc255ec None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:46.023723 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1ef29-5455-4c03-b39b-5dc80fc255ec None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:46.024076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1ef29-5455-4c03-b39b-5dc80fc255ec None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:46.025127 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1ef29-5455-4c03-b39b-5dc80fc255ec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:46.025556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1ef29-5455-4c03-b39b-5dc80fc255ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:46.027143 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1ef29-5455-4c03-b39b-5dc80fc255ec None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:46.047031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 616/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Sat Sep 24 19:21:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:46.053130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40f39e-f887-4fa6-988d-29d8d0e9c85c None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:46.167782 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40f39e-f887-4fa6-988d-29d8d0e9c85c None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:46.204587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc47738-ba40-4a32-b167-608242293c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:46.205134 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc47738-ba40-4a32-b167-608242293c1e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:46.205490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc47738-ba40-4a32-b167-608242293c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:46.205715 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc47738-ba40-4a32-b167-608242293c1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:46.216842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc47738-ba40-4a32-b167-608242293c1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:46.218660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc47738-ba40-4a32-b167-608242293c1e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:46.234040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-7dc47738-ba40-4a32-b167-608242293c1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:46.234040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:46.234040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:46.234040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:46.234040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:46.234040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:46.234040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:46.234040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:46.234040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:46.234040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:46.234040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:46.234040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:46.234040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:21:46.234040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:21:46.234040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:21:46.234040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:21:46.235464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:46.235464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:46.235464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:46.235464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:46.235464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:46.235464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:46.235464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:46.235464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:46.235464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:46.235464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:46.235464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:46.235464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:46.235464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:46.235464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:46.235464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:46.235464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:46.235464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:21:46.236370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:21:46.236370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:46.236370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:21:46.236370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 612/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:46.241872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1ef29-5455-4c03-b39b-5dc80fc255ec None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:46.346070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1ef29-5455-4c03-b39b-5dc80fc255ec None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:46.348516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:46.384637 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a39b39-8420-4109-be44-9a1c2c199bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:46.385385 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a39b39-8420-4109-be44-9a1c2c199bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:46.385745 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a39b39-8420-4109-be44-9a1c2c199bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:46.386115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a39b39-8420-4109-be44-9a1c2c199bf1 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:46.386904 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a39b39-8420-4109-be44-9a1c2c199bf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:46.387266 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a39b39-8420-4109-be44-9a1c2c199bf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:46.388720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a39b39-8420-4109-be44-9a1c2c199bf1 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:46.400365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 617/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:46.406456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc47738-ba40-4a32-b167-608242293c1e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:46.418065 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:46.516320 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc47738-ba40-4a32-b167-608242293c1e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:46.552258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6e7f2-2d32-4d12-be73-38d5e38ca6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:46.553042 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6e7f2-2d32-4d12-be73-38d5e38ca6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:46.553370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6e7f2-2d32-4d12-be73-38d5e38ca6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:46.553662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6e7f2-2d32-4d12-be73-38d5e38ca6e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:46.560763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6e7f2-2d32-4d12-be73-38d5e38ca6e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:46.562199 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6e7f2-2d32-4d12-be73-38d5e38ca6e7 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:46.574923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-3ce6e7f2-2d32-4d12-be73-38d5e38ca6e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:21:46.574923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:46.574923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:46.574923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:46.574923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:46.574923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:46.574923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:46.574923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:46.574923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:46.574923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:46.574923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:46.574923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:46.574923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:21:46.574923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:21:46.574923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:21:46.576018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:21:46.576018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:46.576018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:46.576018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:46.576018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:46.576018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:46.576018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:46.576018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:46.576018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:46.576018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:46.576018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:46.576018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:46.576018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:46.576018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:46.576018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:46.576018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:46.576018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:46.577080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:21:46.577080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:21:46.577080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:21:46.577080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:21:46.577080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:21:46.577080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:21:46.577080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:21:46.577080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:21:46.577080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 613/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:21:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:46.582371 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a39b39-8420-4109-be44-9a1c2c199bf1 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:46.693517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a39b39-8420-4109-be44-9a1c2c199bf1 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:46.740842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb5036-9c57-4ea0-8158-6ca90ae179f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:46.741565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb5036-9c57-4ea0-8158-6ca90ae179f2 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:46.741846 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb5036-9c57-4ea0-8158-6ca90ae179f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:46.742120 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb5036-9c57-4ea0-8158-6ca90ae179f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:46.742804 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb5036-9c57-4ea0-8158-6ca90ae179f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:46.743140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb5036-9c57-4ea0-8158-6ca90ae179f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:46.744579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb5036-9c57-4ea0-8158-6ca90ae179f2 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:46.757615 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 618/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:21:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:46.763699 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6e7f2-2d32-4d12-be73-38d5e38ca6e7 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:46.836841 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:46.874323 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6e7f2-2d32-4d12-be73-38d5e38ca6e7 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:46.910940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc0953-1a91-45d6-857c-6413b8f6fa7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:46.911595 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc0953-1a91-45d6-857c-6413b8f6fa7b None admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:46.911876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc0953-1a91-45d6-857c-6413b8f6fa7b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:46.912148 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc0953-1a91-45d6-857c-6413b8f6fa7b None admin] PATH_INFO: `/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/95a375bda898420fb9df08d514bf9bff/roles/a2673fe5628247c3a918eaa28d483e9f` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:46.927913 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc0953-1a91-45d6-857c-6413b8f6fa7b None admin] RBAC: Authorizing `identity:create_grant(project_id=f61085f09512451e92c9fa36fa9a8071, user_id=95a375bda898420fb9df08d514bf9bff, role_id=a2673fe5628247c3a918eaa28d483e9f)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:46.929341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc0953-1a91-45d6-857c-6413b8f6fa7b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:46.941939 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 614/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:21:46 2022] PUT /identity/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/95a375bda898420fb9df08d514bf9bff/roles/a2673fe5628247c3a918eaa28d483e9f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:21:49.144505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf48b02-6813-47ec-8075-cda3d958ca72 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:49.145136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf48b02-6813-47ec-8075-cda3d958ca72 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:49.145136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf48b02-6813-47ec-8075-cda3d958ca72 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:49.146411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 619/1233] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:49.151908 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f83cac-2dca-4a73-9908-bc7242619207 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:49.152337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f83cac-2dca-4a73-9908-bc7242619207 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:49.152465 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f83cac-2dca-4a73-9908-bc7242619207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:49.173585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-66f83cac-2dca-4a73-9908-bc7242619207 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:49.174809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-66f83cac-2dca-4a73-9908-bc7242619207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:49.249145 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 615/1234] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:21:49.526035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf48b02-6813-47ec-8075-cda3d958ca72 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:49.554713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:49.647321 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf48b02-6813-47ec-8075-cda3d958ca72 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:49.685861 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f4c6b-6b5c-4398-90b1-be5c9eee3b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:49.686413 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f4c6b-6b5c-4398-90b1-be5c9eee3b1a None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:49.686687 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f4c6b-6b5c-4398-90b1-be5c9eee3b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:49.686988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f4c6b-6b5c-4398-90b1-be5c9eee3b1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:49.698438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f4c6b-6b5c-4398-90b1-be5c9eee3b1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:49.703708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-fc6f4c6b-6b5c-4398-90b1-be5c9eee3b1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:21:49.703708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:49.703708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:49.703708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:49.703708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:49.703708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:49.703708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:49.703708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:49.703708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:49.703708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:49.703708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:49.703708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:49.703708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:49.703708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:49.703708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:49.703708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:49.704739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:49.704739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:49.704739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:49.704739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:49.704739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:49.704739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:49.704739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:49.704739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:49.704739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:49.704739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:49.704739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:49.704739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:49.704739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:49.704739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:49.704739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:49.704739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:49.705599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:49.705599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:49.705599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:49.705599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:49.705599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:49.705599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:49.705599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:49.705599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:49.705599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:49.705599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:49.705599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:21:49.705599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:21:49.705599 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 620/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Sat Sep 24 19:21:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:49.711370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f83cac-2dca-4a73-9908-bc7242619207 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:49.759423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:49.819477 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f83cac-2dca-4a73-9908-bc7242619207 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:49.859617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822b773-a84b-4ac7-a038-b1347c1b9f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:49.860223 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822b773-a84b-4ac7-a038-b1347c1b9f5b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:49.860497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822b773-a84b-4ac7-a038-b1347c1b9f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:49.860764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822b773-a84b-4ac7-a038-b1347c1b9f5b None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:49.861495 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822b773-a84b-4ac7-a038-b1347c1b9f5b None admin] RBAC: Adding query filter params (name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:49.861796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822b773-a84b-4ac7-a038-b1347c1b9f5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:49.863991 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822b773-a84b-4ac7-a038-b1347c1b9f5b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:49.872538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 616/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Sat Sep 24 19:21:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:49.879766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f4c6b-6b5c-4398-90b1-be5c9eee3b1a None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:49.969093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:49.984762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f4c6b-6b5c-4398-90b1-be5c9eee3b1a None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:50.020414 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa3749-d1cc-4766-8072-7cfac4fff763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:50.021042 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa3749-d1cc-4766-8072-7cfac4fff763 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:50.021315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa3749-d1cc-4766-8072-7cfac4fff763 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:50.021616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa3749-d1cc-4766-8072-7cfac4fff763 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:50.033560 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa3749-d1cc-4766-8072-7cfac4fff763 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:50.035725 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa3749-d1cc-4766-8072-7cfac4fff763 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:50.052202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-8bfa3749-d1cc-4766-8072-7cfac4fff763 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:50.052202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:50.052202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:50.052202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:50.052202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:50.052202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:50.052202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:50.052202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:50.052202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:50.052202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:50.052202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:50.052202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:50.052202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:21:50.052202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:21:50.052202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:21:50.052202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:21:50.053306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:50.053306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:50.053306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:50.053306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:50.053306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:50.053306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:50.053306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:50.053306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:50.053306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:50.053306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:50.053306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:50.053306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:50.053306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:50.053306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:50.053306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:50.053306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:50.053306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:21:50.054649 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:21:50.054649 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:50.054649 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:21:50.054649 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 621/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:50.059451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822b773-a84b-4ac7-a038-b1347c1b9f5b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:50.172177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822b773-a84b-4ac7-a038-b1347c1b9f5b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:50.182207 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:50.214282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e3144-5f0c-4645-a389-5696ac580c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:50.214934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e3144-5f0c-4645-a389-5696ac580c74 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:50.215220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e3144-5f0c-4645-a389-5696ac580c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:50.215494 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e3144-5f0c-4645-a389-5696ac580c74 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:50.216133 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e3144-5f0c-4645-a389-5696ac580c74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:50.216436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e3144-5f0c-4645-a389-5696ac580c74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:50.217800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e3144-5f0c-4645-a389-5696ac580c74 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:50.229977 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 617/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:50.235739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa3749-d1cc-4766-8072-7cfac4fff763 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:50.352629 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa3749-d1cc-4766-8072-7cfac4fff763 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:50.390075 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71013eac-f169-4fff-aa18-7e559451d035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:50.390711 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71013eac-f169-4fff-aa18-7e559451d035 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:50.391041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71013eac-f169-4fff-aa18-7e559451d035 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:50.391314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71013eac-f169-4fff-aa18-7e559451d035 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:50.394444 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:50.400373 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71013eac-f169-4fff-aa18-7e559451d035 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:50.402262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71013eac-f169-4fff-aa18-7e559451d035 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:50.415655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-71013eac-f169-4fff-aa18-7e559451d035 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:21:50.415655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:50.415655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:50.415655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:50.415655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:50.415655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:50.415655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:50.415655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:50.415655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:50.415655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:50.415655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:50.415655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:50.415655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:21:50.415655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:21:50.415655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:21:50.415655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:21:50.416822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:50.416822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:50.416822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:21:50.416822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:21:50.416822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:21:50.416822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:21:50.416822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:50.416822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:50.416822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:50.416822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:50.416822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:50.416822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:50.416822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:50.416822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:50.416822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:50.416822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:50.416822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:50.416822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:50.417785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:50.417785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:50.417785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:21:50.417785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:21:50.417785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:21:50.417785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:21:50.417785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:21:50.417785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:21:50.417785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:21:50.417785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:21:50.417785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 622/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:50.423737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e3144-5f0c-4645-a389-5696ac580c74 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:50.536616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e3144-5f0c-4645-a389-5696ac580c74 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:50.572549 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f158893-bf62-4a6a-9a19-e7a8870b45c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:50.573195 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f158893-bf62-4a6a-9a19-e7a8870b45c8 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:50.573482 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f158893-bf62-4a6a-9a19-e7a8870b45c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:50.573831 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f158893-bf62-4a6a-9a19-e7a8870b45c8 None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:50.574535 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f158893-bf62-4a6a-9a19-e7a8870b45c8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:50.574867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f158893-bf62-4a6a-9a19-e7a8870b45c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:50.576301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f158893-bf62-4a6a-9a19-e7a8870b45c8 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:50.595786 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 618/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Sat Sep 24 19:21:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:50.602564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71013eac-f169-4fff-aa18-7e559451d035 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:50.728100 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71013eac-f169-4fff-aa18-7e559451d035 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:50.766413 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c4b31-37e6-4f31-a436-426450a2f66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:50.767041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c4b31-37e6-4f31-a436-426450a2f66e None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:50.767317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c4b31-37e6-4f31-a436-426450a2f66e None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:50.767585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c4b31-37e6-4f31-a436-426450a2f66e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:50.838138 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:50.845006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c4b31-37e6-4f31-a436-426450a2f66e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:50.846438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c4b31-37e6-4f31-a436-426450a2f66e None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:50.953205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 623/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 19:21:50.961028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f158893-bf62-4a6a-9a19-e7a8870b45c8 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:50.996228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:51.076875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f158893-bf62-4a6a-9a19-e7a8870b45c8 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:51.117741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d170b9-38d2-4215-a0f4-117a0f2842dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:51.118469 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d170b9-38d2-4215-a0f4-117a0f2842dd None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:51.118822 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d170b9-38d2-4215-a0f4-117a0f2842dd None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:51.119192 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d170b9-38d2-4215-a0f4-117a0f2842dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:51.133028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d170b9-38d2-4215-a0f4-117a0f2842dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:51.134526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d170b9-38d2-4215-a0f4-117a0f2842dd None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:51.150930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-17d170b9-38d2-4215-a0f4-117a0f2842dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:51.150930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:51.150930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:51.150930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:51.150930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:51.150930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:51.150930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:51.150930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:51.150930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:51.150930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:51.150930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:51.150930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:51.150930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:21:51.150930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:21:51.150930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:21:51.150930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:21:51.153920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:51.153920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:51.153920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:51.153920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:51.153920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:51.153920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:51.153920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:51.153920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:51.153920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:51.153920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:51.153920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:51.153920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:51.153920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:51.153920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:51.153920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:51.153920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:51.153920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:21:51.155059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:21:51.155059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:51.155059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:21:51.155059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 619/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:51.159206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c4b31-37e6-4f31-a436-426450a2f66e None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:51.263791 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:51.271195 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c4b31-37e6-4f31-a436-426450a2f66e None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:51.308452 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593c73b-410a-4c3f-9b5e-eaa08c50b51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:51.309146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593c73b-410a-4c3f-9b5e-eaa08c50b51f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:51.309424 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593c73b-410a-4c3f-9b5e-eaa08c50b51f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:51.309693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593c73b-410a-4c3f-9b5e-eaa08c50b51f None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:51.310388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593c73b-410a-4c3f-9b5e-eaa08c50b51f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:51.310760 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593c73b-410a-4c3f-9b5e-eaa08c50b51f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:51.312383 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593c73b-410a-4c3f-9b5e-eaa08c50b51f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:51.325767 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 624/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:51.331746 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d170b9-38d2-4215-a0f4-117a0f2842dd None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:51.427477 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:51.456267 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d170b9-38d2-4215-a0f4-117a0f2842dd None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:51.494059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c43d4-ed7c-4191-9bbd-2013fed2ed89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:51.494699 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c43d4-ed7c-4191-9bbd-2013fed2ed89 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:51.495004 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c43d4-ed7c-4191-9bbd-2013fed2ed89 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:51.495280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c43d4-ed7c-4191-9bbd-2013fed2ed89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:51.502650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c43d4-ed7c-4191-9bbd-2013fed2ed89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:51.504280 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c43d4-ed7c-4191-9bbd-2013fed2ed89 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:51.515636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-072c43d4-ed7c-4191-9bbd-2013fed2ed89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:21:51.515636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:51.515636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:51.515636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:51.515636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:51.515636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:51.515636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:51.515636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:51.515636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:51.515636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:51.515636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:51.515636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:51.515636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:21:51.515636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:21:51.515636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:21:51.517055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:21:51.517055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:51.517055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:51.517055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:51.517055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:51.517055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:51.517055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:51.517055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:51.517055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:51.517055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:51.517055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:51.517055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:51.517055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:51.517055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:51.517055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:51.517055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:51.517055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:51.518198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:21:51.518198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:21:51.518198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:21:51.518198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:21:51.518198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:21:51.518198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:21:51.518198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:21:51.518198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:21:51.518198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 620/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:21:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:51.523238 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593c73b-410a-4c3f-9b5e-eaa08c50b51f None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:51.634324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593c73b-410a-4c3f-9b5e-eaa08c50b51f None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:51.674200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b668a-236a-403a-9e30-d913e69eb873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:51.674742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b668a-236a-403a-9e30-d913e69eb873 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:51.675723 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b668a-236a-403a-9e30-d913e69eb873 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:51.675987 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b668a-236a-403a-9e30-d913e69eb873 None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:51.676737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b668a-236a-403a-9e30-d913e69eb873 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:51.677042 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b668a-236a-403a-9e30-d913e69eb873 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:51.678466 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b668a-236a-403a-9e30-d913e69eb873 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:51.692007 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 625/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:21:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:51.698303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c43d4-ed7c-4191-9bbd-2013fed2ed89 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:51.812918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c43d4-ed7c-4191-9bbd-2013fed2ed89 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:51.851536 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ba748-71e4-4da5-84c0-c7946ac0b731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:51.852175 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ba748-71e4-4da5-84c0-c7946ac0b731 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:51.852453 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ba748-71e4-4da5-84c0-c7946ac0b731 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:51.852734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ba748-71e4-4da5-84c0-c7946ac0b731 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:51.853458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ba748-71e4-4da5-84c0-c7946ac0b731 None admin] RBAC: Adding query filter params (role.id=a2673fe5628247c3a918eaa28d483e9f, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=95a375bda898420fb9df08d514bf9bff) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:51.853763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ba748-71e4-4da5-84c0-c7946ac0b731 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:51.855234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ba748-71e4-4da5-84c0-c7946ac0b731 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:51.861096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 621/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:21:51 2022] GET /identity/v3/role_assignments?user.id=95a375bda898420fb9df08d514bf9bff&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=a2673fe5628247c3a918eaa28d483e9f => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:54.646603 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8de036-d36c-41db-91e6-88e2f69c4d32 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:54.647165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8de036-d36c-41db-91e6-88e2f69c4d32 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:54.647165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8de036-d36c-41db-91e6-88e2f69c4d32 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:54.648739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 626/1247] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:54.654064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cfa9d-5c58-47de-8f78-9d1a0cd8a188 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:54.654494 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cfa9d-5c58-47de-8f78-9d1a0cd8a188 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:54.654594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cfa9d-5c58-47de-8f78-9d1a0cd8a188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:54.661037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:54.673677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-705cfa9d-5c58-47de-8f78-9d1a0cd8a188 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:54.675692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-705cfa9d-5c58-47de-8f78-9d1a0cd8a188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:54.757335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 622/1248] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:21:55.031632 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8de036-d36c-41db-91e6-88e2f69c4d32 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:55.052747 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:55.155005 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8de036-d36c-41db-91e6-88e2f69c4d32 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:55.192224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e800a8-f1b3-4df9-8138-8cb406ffe6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:55.192857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e800a8-f1b3-4df9-8138-8cb406ffe6bd None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:55.193137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e800a8-f1b3-4df9-8138-8cb406ffe6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:55.193411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e800a8-f1b3-4df9-8138-8cb406ffe6bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:55.204032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e800a8-f1b3-4df9-8138-8cb406ffe6bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:55.209685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-49e800a8-f1b3-4df9-8138-8cb406ffe6bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:21:55.209685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:55.209685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:55.209685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:55.209685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:55.209685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:55.209685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:55.209685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:55.209685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:55.209685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:55.209685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:55.209685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:55.209685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:55.209685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:55.209685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:55.209685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:55.210905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:55.210905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:55.210905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:55.210905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:55.210905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:55.210905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:55.210905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:55.210905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:55.210905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:55.210905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:55.210905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:55.210905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:55.210905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:55.210905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:55.210905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:55.210905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:55.211960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:55.211960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:55.211960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:55.211960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:55.211960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:55.211960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:55.211960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:55.211960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:55.211960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:55.211960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:55.211960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:21:55.211960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:21:55.215844 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 627/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:21:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:55.217304 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cfa9d-5c58-47de-8f78-9d1a0cd8a188 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:55.342872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cfa9d-5c58-47de-8f78-9d1a0cd8a188 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:55.375142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:55.381647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadeda03-88a4-4ace-9403-f25f87a04920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:55.382267 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadeda03-88a4-4ace-9403-f25f87a04920 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:55.382545 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadeda03-88a4-4ace-9403-f25f87a04920 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:55.382818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadeda03-88a4-4ace-9403-f25f87a04920 None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:55.383595 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadeda03-88a4-4ace-9403-f25f87a04920 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:55.383916 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadeda03-88a4-4ace-9403-f25f87a04920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:55.385311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadeda03-88a4-4ace-9403-f25f87a04920 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:55.394659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 623/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:55.401141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e800a8-f1b3-4df9-8138-8cb406ffe6bd None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:55.483031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:55.508014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e800a8-f1b3-4df9-8138-8cb406ffe6bd None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:55.543264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9a28b-7f8b-402c-8443-e2a32ebbc8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:55.543896 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9a28b-7f8b-402c-8443-e2a32ebbc8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:55.544174 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9a28b-7f8b-402c-8443-e2a32ebbc8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:55.544441 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9a28b-7f8b-402c-8443-e2a32ebbc8d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:55.555537 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9a28b-7f8b-402c-8443-e2a32ebbc8d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:55.557027 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9a28b-7f8b-402c-8443-e2a32ebbc8d5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:55.573326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-22d9a28b-7f8b-402c-8443-e2a32ebbc8d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:55.573326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:55.573326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:55.573326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:55.573326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:55.573326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:55.573326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:55.573326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:55.573326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:55.573326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:55.573326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:55.573326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:55.573326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:21:55.573326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:21:55.573326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:21:55.573326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:21:55.574546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:55.574546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:55.574546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:55.574546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:55.574546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:55.574546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:55.574546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:55.574546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:55.574546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:55.574546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:55.574546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:55.574546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:55.574546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:55.574546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:55.574546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:55.574546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:55.574546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:21:55.575541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:21:55.575541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:55.575541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:21:55.579436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 628/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:55.580646 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadeda03-88a4-4ace-9403-f25f87a04920 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:55.689453 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadeda03-88a4-4ace-9403-f25f87a04920 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:55.725312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853eefd2-0c10-439c-804e-5b18814c84b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:55.725920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eefd2-0c10-439c-804e-5b18814c84b6 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:55.726193 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eefd2-0c10-439c-804e-5b18814c84b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:55.726464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eefd2-0c10-439c-804e-5b18814c84b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:55.727128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853eefd2-0c10-439c-804e-5b18814c84b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:55.727424 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853eefd2-0c10-439c-804e-5b18814c84b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:55.728774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853eefd2-0c10-439c-804e-5b18814c84b6 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:55.741168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 624/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:55.747044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9a28b-7f8b-402c-8443-e2a32ebbc8d5 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:55.848391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9a28b-7f8b-402c-8443-e2a32ebbc8d5 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:55.874263 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:55.882963 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80917502-db1d-45d3-98c9-fc3ac32cc00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:55.883591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80917502-db1d-45d3-98c9-fc3ac32cc00c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:55.883865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80917502-db1d-45d3-98c9-fc3ac32cc00c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:55.884137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80917502-db1d-45d3-98c9-fc3ac32cc00c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:55.894869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80917502-db1d-45d3-98c9-fc3ac32cc00c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:55.896335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80917502-db1d-45d3-98c9-fc3ac32cc00c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:55.907930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-80917502-db1d-45d3-98c9-fc3ac32cc00c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:21:55.907930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:55.907930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:55.907930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:55.907930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:55.907930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:55.907930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:55.907930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:55.907930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:55.907930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:55.907930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:55.907930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:55.907930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:21:55.907930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:21:55.907930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:21:55.907930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:21:55.908950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:55.908950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:55.908950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:21:55.908950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:21:55.908950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:21:55.908950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:21:55.908950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:55.908950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:55.908950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:55.908950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:55.908950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:55.908950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:55.908950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:55.908950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:55.908950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:55.908950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:55.908950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:55.908950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:55.911607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:55.911607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:55.911607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:21:55.911607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:21:55.911607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:21:55.911607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:21:55.911607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:21:55.911607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:21:55.911607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:21:55.911607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:21:55.911607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 629/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:55.919817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853eefd2-0c10-439c-804e-5b18814c84b6 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:55.979752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:56.024686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853eefd2-0c10-439c-804e-5b18814c84b6 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:56.057798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfca9c-4c21-42ac-a170-ea576f35702e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:56.058396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfca9c-4c21-42ac-a170-ea576f35702e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:56.058675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfca9c-4c21-42ac-a170-ea576f35702e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:56.058980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfca9c-4c21-42ac-a170-ea576f35702e None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:56.059696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfca9c-4c21-42ac-a170-ea576f35702e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:56.060004 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfca9c-4c21-42ac-a170-ea576f35702e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:56.061418 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfca9c-4c21-42ac-a170-ea576f35702e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:56.078712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 625/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Sat Sep 24 19:21:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:56.086179 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80917502-db1d-45d3-98c9-fc3ac32cc00c None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:56.189957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80917502-db1d-45d3-98c9-fc3ac32cc00c None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:56.222541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9395a9-d855-4c3d-942b-afa6b632c9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:56.223154 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9395a9-d855-4c3d-942b-afa6b632c9d0 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:56.223431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9395a9-d855-4c3d-942b-afa6b632c9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:56.223697 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9395a9-d855-4c3d-942b-afa6b632c9d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:56.276068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:56.288584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9395a9-d855-4c3d-942b-afa6b632c9d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:56.290008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9395a9-d855-4c3d-942b-afa6b632c9d0 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:56.383409 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 630/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:21:56.389215 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfca9c-4c21-42ac-a170-ea576f35702e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:56.489530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfca9c-4c21-42ac-a170-ea576f35702e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:56.502191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:56.524154 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e40ddf-b5a5-4eeb-8ba2-cfa1e32a5c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:56.525064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e40ddf-b5a5-4eeb-8ba2-cfa1e32a5c74 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:56.525342 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e40ddf-b5a5-4eeb-8ba2-cfa1e32a5c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:56.525609 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e40ddf-b5a5-4eeb-8ba2-cfa1e32a5c74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:56.535474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e40ddf-b5a5-4eeb-8ba2-cfa1e32a5c74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:56.536832 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e40ddf-b5a5-4eeb-8ba2-cfa1e32a5c74 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:56.550872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-b1e40ddf-b5a5-4eeb-8ba2-cfa1e32a5c74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:56.550872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:56.550872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:56.550872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:56.550872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:56.550872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:56.550872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:56.550872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:56.550872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:56.550872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:56.550872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:56.550872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:56.550872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:21:56.550872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:21:56.550872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:21:56.550872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:21:56.552015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:56.552015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:56.552015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:56.552015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:56.552015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:56.552015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:56.552015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:56.552015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:56.552015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:56.552015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:56.552015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:56.552015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:56.552015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:56.552015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:56.552015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:56.552015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:56.552015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:21:56.553171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:21:56.553171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:56.553171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:21:56.553171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 626/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:56.557791 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9395a9-d855-4c3d-942b-afa6b632c9d0 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:56.642422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:56.655302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9395a9-d855-4c3d-942b-afa6b632c9d0 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:56.687904 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672d987-edfa-49ab-a806-5b6b80045e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:56.688495 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672d987-edfa-49ab-a806-5b6b80045e54 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:56.688773 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672d987-edfa-49ab-a806-5b6b80045e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:56.689047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672d987-edfa-49ab-a806-5b6b80045e54 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:56.689671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672d987-edfa-49ab-a806-5b6b80045e54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:56.689971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672d987-edfa-49ab-a806-5b6b80045e54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:56.691908 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672d987-edfa-49ab-a806-5b6b80045e54 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:56.702682 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 631/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:56.708866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e40ddf-b5a5-4eeb-8ba2-cfa1e32a5c74 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:56.808924 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e40ddf-b5a5-4eeb-8ba2-cfa1e32a5c74 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:56.842185 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c36d60-6c09-4a3b-a8eb-aba9a5898e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:56.842803 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c36d60-6c09-4a3b-a8eb-aba9a5898e79 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:56.843109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c36d60-6c09-4a3b-a8eb-aba9a5898e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:56.843377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c36d60-6c09-4a3b-a8eb-aba9a5898e79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:56.849852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c36d60-6c09-4a3b-a8eb-aba9a5898e79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:56.851305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c36d60-6c09-4a3b-a8eb-aba9a5898e79 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:56.862136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-92c36d60-6c09-4a3b-a8eb-aba9a5898e79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:21:56.862136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:56.862136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:56.862136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:56.862136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:56.862136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:56.862136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:56.862136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:56.862136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:56.862136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:56.862136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:56.862136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:56.862136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:21:56.862136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:21:56.862136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:21:56.863799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:21:56.863799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:56.863799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:56.863799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:56.863799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:56.863799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:56.863799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:56.863799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:56.863799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:56.863799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:56.863799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:56.863799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:56.863799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:56.863799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:56.863799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:56.863799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:56.863799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:56.865117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:21:56.865117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:21:56.865117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:21:56.865117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:21:56.865117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:21:56.865117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:21:56.865117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:21:56.865117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:21:56.865117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 627/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:21:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:56.869674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672d987-edfa-49ab-a806-5b6b80045e54 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:56.966898 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672d987-edfa-49ab-a806-5b6b80045e54 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:56.999583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d758bb8-6194-4ae0-807a-3d3c1adf58ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:57.000183 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d758bb8-6194-4ae0-807a-3d3c1adf58ac None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:57.000461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d758bb8-6194-4ae0-807a-3d3c1adf58ac None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:57.000732 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d758bb8-6194-4ae0-807a-3d3c1adf58ac None admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:57.001405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d758bb8-6194-4ae0-807a-3d3c1adf58ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:57.001708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d758bb8-6194-4ae0-807a-3d3c1adf58ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:57.003183 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d758bb8-6194-4ae0-807a-3d3c1adf58ac None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:57.014589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 632/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:21:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:57.021142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c36d60-6c09-4a3b-a8eb-aba9a5898e79 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:57.046745 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:57.130701 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c36d60-6c09-4a3b-a8eb-aba9a5898e79 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:57.165338 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebdf8cf-4c62-4731-93be-45093e9f9ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:57.165927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdf8cf-4c62-4731-93be-45093e9f9ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:57.166200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdf8cf-4c62-4731-93be-45093e9f9ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:57.166464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebdf8cf-4c62-4731-93be-45093e9f9ce4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:57.167195 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebdf8cf-4c62-4731-93be-45093e9f9ce4 None admin] RBAC: Adding query filter params (role.id=dd27845a836a4f6ebece149dbebc59c0, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=95a375bda898420fb9df08d514bf9bff) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:57.167496 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebdf8cf-4c62-4731-93be-45093e9f9ce4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:57.168899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebdf8cf-4c62-4731-93be-45093e9f9ce4 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:57.174130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 628/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:21:57 2022] GET /identity/v3/role_assignments?user.id=95a375bda898420fb9df08d514bf9bff&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=dd27845a836a4f6ebece149dbebc59c0 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:59.303837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be60260-9bed-43e2-9629-0bb5b6f3523c None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:59.304404 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be60260-9bed-43e2-9629-0bb5b6f3523c None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:59.304404 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be60260-9bed-43e2-9629-0bb5b6f3523c None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:59.305752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 633/1261] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:59.310772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5a33d-4998-4e47-95ae-5f41b7a3dd43 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:59.311243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5a33d-4998-4e47-95ae-5f41b7a3dd43 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:59.311338 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5a33d-4998-4e47-95ae-5f41b7a3dd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:59.329729 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-5aa5a33d-4998-4e47-95ae-5f41b7a3dd43 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:59.330930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-5aa5a33d-4998-4e47-95ae-5f41b7a3dd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:59.395264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 629/1262] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:21:59.664691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be60260-9bed-43e2-9629-0bb5b6f3523c None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:59.675476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:59.764305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be60260-9bed-43e2-9629-0bb5b6f3523c None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:59.796325 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ce582-74ae-43b1-8a77-ce4b4cc38660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:59.796940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ce582-74ae-43b1-8a77-ce4b4cc38660 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:59.797215 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ce582-74ae-43b1-8a77-ce4b4cc38660 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:59.797486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ce582-74ae-43b1-8a77-ce4b4cc38660 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:59.807910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ce582-74ae-43b1-8a77-ce4b4cc38660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:59.812621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-e94ce582-74ae-43b1-8a77-ce4b4cc38660 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:21:59.812621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:59.812621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:59.812621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:59.812621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:59.812621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:59.812621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:59.812621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:59.812621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:59.812621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:59.812621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:59.812621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:59.812621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:59.812621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:59.812621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:59.812621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:59.813718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:59.813718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:59.813718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:59.813718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:59.813718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:59.813718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:59.813718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:59.813718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:59.813718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:59.813718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:59.813718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:59.813718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:59.813718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:59.813718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:59.813718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:59.813718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:59.814636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:59.814636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:59.814636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:59.814636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:59.814636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:59.814636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:59.814636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:59.814636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:59.814636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:59.814636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:59.814636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:21:59.814636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:21:59.814636 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 634/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:21:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:59.819751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5a33d-4998-4e47-95ae-5f41b7a3dd43 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:59.838035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:59.916178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5a33d-4998-4e47-95ae-5f41b7a3dd43 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:59.948225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84954e-e0c8-4435-b240-a3a6f421d94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:59.948818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84954e-e0c8-4435-b240-a3a6f421d94f None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:59.949095 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84954e-e0c8-4435-b240-a3a6f421d94f None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:59.949362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84954e-e0c8-4435-b240-a3a6f421d94f None admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:59.950008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84954e-e0c8-4435-b240-a3a6f421d94f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:59.950308 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84954e-e0c8-4435-b240-a3a6f421d94f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:59.951680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84954e-e0c8-4435-b240-a3a6f421d94f None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:59.960105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 630/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:59.965779 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ce582-74ae-43b1-8a77-ce4b4cc38660 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:00.031523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:00.064340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ce582-74ae-43b1-8a77-ce4b4cc38660 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:00.112273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac32ba-4eac-449b-b3fb-ca85881c3475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:00.112873 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac32ba-4eac-449b-b3fb-ca85881c3475 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:00.113151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac32ba-4eac-449b-b3fb-ca85881c3475 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:00.113419 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac32ba-4eac-449b-b3fb-ca85881c3475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:00.124475 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac32ba-4eac-449b-b3fb-ca85881c3475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:00.125977 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac32ba-4eac-449b-b3fb-ca85881c3475 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:00.141497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-18ac32ba-4eac-449b-b3fb-ca85881c3475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:00.141497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:00.141497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:00.141497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:00.141497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:00.141497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:00.141497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:00.141497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:00.141497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:00.141497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:00.141497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:00.141497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:00.141497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:00.141497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:00.141497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:00.141497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:00.142548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:00.142548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:00.142548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:00.142548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:00.142548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:00.142548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:00.142548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:00.142548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:00.142548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:00.142548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:00.142548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:00.142548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:00.142548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:00.142548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:00.142548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:00.142548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:00.142548 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:00.147722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:00.147722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:00.147722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:22:00.147722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 635/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:00.149856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84954e-e0c8-4435-b240-a3a6f421d94f None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:00.235002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:00.254910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84954e-e0c8-4435-b240-a3a6f421d94f None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:00.289371 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd1785-e9bc-44d6-8980-d87779d3fe2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:00.289970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd1785-e9bc-44d6-8980-d87779d3fe2a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:00.290281 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd1785-e9bc-44d6-8980-d87779d3fe2a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:00.290556 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd1785-e9bc-44d6-8980-d87779d3fe2a None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:00.291448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd1785-e9bc-44d6-8980-d87779d3fe2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:00.291891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd1785-e9bc-44d6-8980-d87779d3fe2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:00.293298 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd1785-e9bc-44d6-8980-d87779d3fe2a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:00.305464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 631/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:00.311214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac32ba-4eac-449b-b3fb-ca85881c3475 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:00.407075 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac32ba-4eac-449b-b3fb-ca85881c3475 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:00.427487 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:00.441538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb14cca-ce92-44d8-8680-4e7344b606a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:00.442159 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb14cca-ce92-44d8-8680-4e7344b606a8 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:00.442439 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb14cca-ce92-44d8-8680-4e7344b606a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:00.442713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb14cca-ce92-44d8-8680-4e7344b606a8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:00.449931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb14cca-ce92-44d8-8680-4e7344b606a8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:00.451413 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb14cca-ce92-44d8-8680-4e7344b606a8 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:00.462327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-ecb14cca-ce92-44d8-8680-4e7344b606a8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:22:00.462327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:00.462327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:00.462327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:00.462327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:00.462327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:00.462327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:00.462327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:00.462327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:00.462327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:00.462327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:00.462327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:00.462327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:22:00.462327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:22:00.462327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:22:00.462327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:22:00.463461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:00.463461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:00.463461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:22:00.463461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:00.463461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:22:00.463461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:00.463461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:00.463461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:00.463461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:00.463461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:00.463461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:00.463461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:00.463461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:00.463461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:00.463461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:00.463461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:00.463461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:00.463461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:00.464639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:00.464639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:00.464639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:22:00.464639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:22:00.464639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:22:00.464639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:22:00.464639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:22:00.464639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:22:00.464639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:22:00.464639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:22:00.464639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 636/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:00.469300 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd1785-e9bc-44d6-8980-d87779d3fe2a None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:00.566707 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd1785-e9bc-44d6-8980-d87779d3fe2a None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:00.599297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63b76b-70d1-4ac7-b17b-6637dda1f66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:00.599886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63b76b-70d1-4ac7-b17b-6637dda1f66b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:00.600160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63b76b-70d1-4ac7-b17b-6637dda1f66b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:00.600428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63b76b-70d1-4ac7-b17b-6637dda1f66b None admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:00.601137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63b76b-70d1-4ac7-b17b-6637dda1f66b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:00.601436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63b76b-70d1-4ac7-b17b-6637dda1f66b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:00.602854 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63b76b-70d1-4ac7-b17b-6637dda1f66b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:00.611146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:00.620357 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 632/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Sat Sep 24 19:22:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:00.626088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb14cca-ce92-44d8-8680-4e7344b606a8 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:00.724851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb14cca-ce92-44d8-8680-4e7344b606a8 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:00.757751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01225f68-80d5-411a-aecf-74917537db00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:00.758359 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01225f68-80d5-411a-aecf-74917537db00 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:00.758630 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01225f68-80d5-411a-aecf-74917537db00 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:00.758924 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01225f68-80d5-411a-aecf-74917537db00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:00.769204 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01225f68-80d5-411a-aecf-74917537db00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:00.770611 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01225f68-80d5-411a-aecf-74917537db00 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:00.784543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-01225f68-80d5-411a-aecf-74917537db00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:00.784543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:00.784543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:00.784543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:00.784543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:00.784543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:00.784543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:00.784543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:00.784543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:00.784543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:00.784543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:00.784543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:00.784543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:00.784543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:00.784543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:00.784543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:00.785634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:00.785634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:00.785634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:00.785634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:00.785634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:00.785634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:00.785634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:00.785634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:00.785634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:00.785634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:00.785634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:00.785634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:00.785634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:00.785634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:00.785634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:00.785634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:00.785634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:00.786751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:00.786751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:00.786751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:22:00.786751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 637/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:00.791544 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63b76b-70d1-4ac7-b17b-6637dda1f66b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:00.890379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63b76b-70d1-4ac7-b17b-6637dda1f66b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:00.924634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044195a-f13b-4c65-a4c8-08d5ea3c2d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:00.925811 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044195a-f13b-4c65-a4c8-08d5ea3c2d4b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:00.926091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044195a-f13b-4c65-a4c8-08d5ea3c2d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:00.926361 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044195a-f13b-4c65-a4c8-08d5ea3c2d4b None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:00.927023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044195a-f13b-4c65-a4c8-08d5ea3c2d4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:00.927326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044195a-f13b-4c65-a4c8-08d5ea3c2d4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:00.928666 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044195a-f13b-4c65-a4c8-08d5ea3c2d4b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:00.939404 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 633/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:00.945072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01225f68-80d5-411a-aecf-74917537db00 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:00.975990 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:01.043234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01225f68-80d5-411a-aecf-74917537db00 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:01.075854 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0025bc4-b857-4a41-876d-c577644c1e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:01.076638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0025bc4-b857-4a41-876d-c577644c1e0f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:01.077008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0025bc4-b857-4a41-876d-c577644c1e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:01.077278 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0025bc4-b857-4a41-876d-c577644c1e0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:01.086473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0025bc4-b857-4a41-876d-c577644c1e0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:01.088220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0025bc4-b857-4a41-876d-c577644c1e0f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:01.103253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-c0025bc4-b857-4a41-876d-c577644c1e0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:01.103253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:01.103253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:01.103253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:01.103253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:01.103253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:01.103253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:01.103253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:01.103253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:01.103253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:01.103253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:01.103253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:01.103253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:22:01.103253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:22:01.103253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:22:01.104252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:22:01.104252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:01.104252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:01.104252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:01.104252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:01.104252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:01.104252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:01.104252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:01.104252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:01.104252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:01.104252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:01.104252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:01.104252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:01.104252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:01.104252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:01.104252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:01.104252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:01.105272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:22:01.105272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:22:01.105272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:22:01.105272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:22:01.105272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:22:01.105272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:22:01.105272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:01.105272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:22:01.105272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 638/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:22:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:22:01.110696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044195a-f13b-4c65-a4c8-08d5ea3c2d4b None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:01.168356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:01.209329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044195a-f13b-4c65-a4c8-08d5ea3c2d4b None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:01.242256 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f94d9-6785-4cb5-8682-5655bf5bbd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:01.242867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f94d9-6785-4cb5-8682-5655bf5bbd62 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:01.243148 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f94d9-6785-4cb5-8682-5655bf5bbd62 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:01.243416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f94d9-6785-4cb5-8682-5655bf5bbd62 None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:01.244093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f94d9-6785-4cb5-8682-5655bf5bbd62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:01.244395 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f94d9-6785-4cb5-8682-5655bf5bbd62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:01.245799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f94d9-6785-4cb5-8682-5655bf5bbd62 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:01.257554 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 634/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:22:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:01.263626 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0025bc4-b857-4a41-876d-c577644c1e0f None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:01.353239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:01.361986 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0025bc4-b857-4a41-876d-c577644c1e0f None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:01.395281 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a24c1-8195-40bd-be0b-4ef921ffe6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:01.395924 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a24c1-8195-40bd-be0b-4ef921ffe6d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:01.396198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a24c1-8195-40bd-be0b-4ef921ffe6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:01.396468 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a24c1-8195-40bd-be0b-4ef921ffe6d5 None admin] PATH_INFO: `/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/95a375bda898420fb9df08d514bf9bff/roles/dd27845a836a4f6ebece149dbebc59c0` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:01.398398 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a24c1-8195-40bd-be0b-4ef921ffe6d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f61085f09512451e92c9fa36fa9a8071, user_id=95a375bda898420fb9df08d514bf9bff, role_id=dd27845a836a4f6ebece149dbebc59c0)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:01.400094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a24c1-8195-40bd-be0b-4ef921ffe6d5 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:01.414396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 639/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Sat Sep 24 19:22:01 2022] PUT /identity/v3/projects/f61085f09512451e92c9fa36fa9a8071/users/95a375bda898420fb9df08d514bf9bff/roles/dd27845a836a4f6ebece149dbebc59c0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:22:03.619683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7119a8-95da-4cac-b275-1053b664708b None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:03.620205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7119a8-95da-4cac-b275-1053b664708b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:03.620205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7119a8-95da-4cac-b275-1053b664708b None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:03.621559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 635/1274] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:03.626632 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6591604-a6ee-436e-9be6-db7c544ec93f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:03.627098 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6591604-a6ee-436e-9be6-db7c544ec93f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:03.627200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6591604-a6ee-436e-9be6-db7c544ec93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:03.645349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-a6591604-a6ee-436e-9be6-db7c544ec93f None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:03.646523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a6591604-a6ee-436e-9be6-db7c544ec93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:03.711780 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 640/1275] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:22:03.980514 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7119a8-95da-4cac-b275-1053b664708b None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:04.085585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7119a8-95da-4cac-b275-1053b664708b None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:04.120719 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:04.145743 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ea498-1914-4365-a6de-c4dfc1e247db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:04.146390 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ea498-1914-4365-a6de-c4dfc1e247db None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:04.146671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ea498-1914-4365-a6de-c4dfc1e247db None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:04.147047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ea498-1914-4365-a6de-c4dfc1e247db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:04.158183 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ea498-1914-4365-a6de-c4dfc1e247db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:22:04.163243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-e87ea498-1914-4365-a6de-c4dfc1e247db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:22:04.163243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:04.163243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:04.163243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:04.163243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:04.163243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:04.163243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:04.163243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:04.163243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:04.163243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:04.163243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:04.163243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:04.163243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:22:04.163243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:22:04.163243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:22:04.163243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:22:04.164240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:22:04.164240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:22:04.164240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:22:04.164240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:22:04.164240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:04.164240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:04.164240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:04.164240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:04.164240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:04.164240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:04.164240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:04.164240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:04.164240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:04.164240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:04.164240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:04.164240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:04.165478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:04.165478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:04.165478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:04.165478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:04.165478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:22:04.165478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:22:04.165478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:22:04.165478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:22:04.165478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:22:04.165478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:22:04.165478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:22:04.165478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:22:04.165478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 636/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Sat Sep 24 19:22:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:04.170417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6591604-a6ee-436e-9be6-db7c544ec93f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:04.248338 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:04.267439 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6591604-a6ee-436e-9be6-db7c544ec93f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:04.300490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39676c-ac69-4d98-8cc5-376688830cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:04.301210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39676c-ac69-4d98-8cc5-376688830cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:04.301483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39676c-ac69-4d98-8cc5-376688830cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:04.301748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39676c-ac69-4d98-8cc5-376688830cf1 None admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:04.302388 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39676c-ac69-4d98-8cc5-376688830cf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:04.302683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39676c-ac69-4d98-8cc5-376688830cf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:04.304059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39676c-ac69-4d98-8cc5-376688830cf1 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:04.311849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 641/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Sat Sep 24 19:22:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:04.318428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ea498-1914-4365-a6de-c4dfc1e247db None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:04.416378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ea498-1914-4365-a6de-c4dfc1e247db None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:04.450996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5d7a9-54e2-411b-a4ff-25ed23591034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:04.451614 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5d7a9-54e2-411b-a4ff-25ed23591034 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:04.451892 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5d7a9-54e2-411b-a4ff-25ed23591034 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:04.452163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5d7a9-54e2-411b-a4ff-25ed23591034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:04.462028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5d7a9-54e2-411b-a4ff-25ed23591034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:04.463490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5d7a9-54e2-411b-a4ff-25ed23591034 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:04.477979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-3bf5d7a9-54e2-411b-a4ff-25ed23591034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:04.477979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:04.477979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:04.477979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:04.477979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:04.477979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:04.477979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:04.477979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:04.477979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:04.477979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:04.477979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:04.477979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:04.477979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:04.477979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:04.477979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:04.477979 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:04.479205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:04.479205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:04.479205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:04.479205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:04.479205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:04.479205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:04.479205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:04.479205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:04.479205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:04.479205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:04.479205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:04.479205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:04.479205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:04.479205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:04.479205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:04.479205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:04.479205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:04.480436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:04.480436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:04.480436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:22:04.480436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 637/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:04.484842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39676c-ac69-4d98-8cc5-376688830cf1 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:04.583218 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39676c-ac69-4d98-8cc5-376688830cf1 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:04.615732 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe10694-4afe-45d8-a721-085962e55df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:04.616319 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe10694-4afe-45d8-a721-085962e55df1 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:04.616596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe10694-4afe-45d8-a721-085962e55df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:04.616863 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe10694-4afe-45d8-a721-085962e55df1 None admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:04.617482 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe10694-4afe-45d8-a721-085962e55df1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:04.617781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe10694-4afe-45d8-a721-085962e55df1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:04.619155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe10694-4afe-45d8-a721-085962e55df1 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:04.630418 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 642/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:04.635954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5d7a9-54e2-411b-a4ff-25ed23591034 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:04.667002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:04.734638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5d7a9-54e2-411b-a4ff-25ed23591034 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:04.767335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbce1b9-7a2c-400c-be84-167d926c1d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:04.767949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbce1b9-7a2c-400c-be84-167d926c1d7e None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:04.768258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbce1b9-7a2c-400c-be84-167d926c1d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:04.768539 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbce1b9-7a2c-400c-be84-167d926c1d7e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:04.776772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbce1b9-7a2c-400c-be84-167d926c1d7e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:04.778187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbce1b9-7a2c-400c-be84-167d926c1d7e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:04.789611 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-1fbce1b9-7a2c-400c-be84-167d926c1d7e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:22:04.789611 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:04.789611 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:04.789611 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:04.789611 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:04.789611 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:04.789611 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:04.789611 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:04.789611 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:04.789611 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:04.789611 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:04.789611 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:04.789611 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:22:04.789611 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:22:04.789611 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:22:04.789611 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:22:04.790563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:04.790563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:04.790563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:22:04.790563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:04.790563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:22:04.790563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:04.790563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:04.790563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:04.790563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:04.790563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:04.790563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:04.790563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:04.790563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:04.790563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:04.790563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:04.790563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:04.790563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:04.790563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:04.791619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:04.791619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:04.791619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:22:04.791619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:22:04.791619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:22:04.791619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:22:04.791619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:22:04.791619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:22:04.791619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:22:04.791619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:22:04.791619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 638/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:22:04.796479 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe10694-4afe-45d8-a721-085962e55df1 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:04.800901 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:04.892418 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe10694-4afe-45d8-a721-085962e55df1 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:04.932408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf44673-48a7-47ea-b110-f738d2a0be84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:04.933005 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf44673-48a7-47ea-b110-f738d2a0be84 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:04.933285 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf44673-48a7-47ea-b110-f738d2a0be84 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:04.933553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf44673-48a7-47ea-b110-f738d2a0be84 None admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:04.934260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf44673-48a7-47ea-b110-f738d2a0be84 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:04.934562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf44673-48a7-47ea-b110-f738d2a0be84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:04.936012 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf44673-48a7-47ea-b110-f738d2a0be84 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:04.952523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 643/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Sat Sep 24 19:22:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:04.958266 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbce1b9-7a2c-400c-be84-167d926c1d7e None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:05.046276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:05.056033 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbce1b9-7a2c-400c-be84-167d926c1d7e None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:05.091789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb590b1-732c-48be-bf81-4e2a95cedc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:05.092391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb590b1-732c-48be-bf81-4e2a95cedc91 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:05.092669 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb590b1-732c-48be-bf81-4e2a95cedc91 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:05.092941 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb590b1-732c-48be-bf81-4e2a95cedc91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:05.158580 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb590b1-732c-48be-bf81-4e2a95cedc91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:05.160680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb590b1-732c-48be-bf81-4e2a95cedc91 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:05.245393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:05.256236 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 639/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Sat Sep 24 19:22:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:22:05.262080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf44673-48a7-47ea-b110-f738d2a0be84 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:05.321829 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:05.358205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf44673-48a7-47ea-b110-f738d2a0be84 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:05.390956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e120c4-8305-4250-b62e-aa55def39f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:05.391565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e120c4-8305-4250-b62e-aa55def39f3c None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:05.391841 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e120c4-8305-4250-b62e-aa55def39f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:05.392112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e120c4-8305-4250-b62e-aa55def39f3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:05.402241 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e120c4-8305-4250-b62e-aa55def39f3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:05.403691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e120c4-8305-4250-b62e-aa55def39f3c None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:05.418662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-52e120c4-8305-4250-b62e-aa55def39f3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:05.418662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:05.418662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:05.418662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:05.418662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:05.418662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:05.418662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:05.418662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:05.418662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:05.418662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:05.418662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:05.418662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:05.418662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:05.418662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:05.418662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:05.418662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:05.419849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:05.419849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:05.419849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:05.419849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:05.419849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:05.419849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:05.419849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:05.419849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:05.419849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:05.419849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:05.419849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:05.419849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:05.419849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:05.419849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:05.419849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:05.419849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:05.419849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:05.420952 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:05.420952 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:05.420952 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:22:05.420952 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 644/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:05.426035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb590b1-732c-48be-bf81-4e2a95cedc91 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:05.521852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb590b1-732c-48be-bf81-4e2a95cedc91 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:05.555578 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30697772-c7a8-47f1-9f7b-7dcebf10c846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:05.556169 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30697772-c7a8-47f1-9f7b-7dcebf10c846 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:05.556451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30697772-c7a8-47f1-9f7b-7dcebf10c846 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:05.556722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30697772-c7a8-47f1-9f7b-7dcebf10c846 None admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:05.557348 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30697772-c7a8-47f1-9f7b-7dcebf10c846 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:05.557650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30697772-c7a8-47f1-9f7b-7dcebf10c846 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:05.559022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30697772-c7a8-47f1-9f7b-7dcebf10c846 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:05.569839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 640/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:05.575511 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e120c4-8305-4250-b62e-aa55def39f3c None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:05.671751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e120c4-8305-4250-b62e-aa55def39f3c None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:05.686154 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:05.706569 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066df988-d23e-4d83-924a-48ed8704c455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:05.707205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066df988-d23e-4d83-924a-48ed8704c455 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:05.707478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066df988-d23e-4d83-924a-48ed8704c455 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:05.707743 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066df988-d23e-4d83-924a-48ed8704c455 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:05.714061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066df988-d23e-4d83-924a-48ed8704c455 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:05.715516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066df988-d23e-4d83-924a-48ed8704c455 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:05.726302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application [None req-066df988-d23e-4d83-924a-48ed8704c455 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:05.726302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:05.726302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:05.726302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:05.726302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:05.726302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:05.726302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:05.726302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:05.726302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:05.726302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:05.726302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:05.726302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:05.726302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:22:05.726302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:22:05.726302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:22:05.727394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:22:05.727394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:05.727394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:05.727394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:05.727394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:05.727394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:05.727394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:05.727394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:05.727394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:05.727394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:05.727394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:05.727394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:05.727394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:05.727394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:05.727394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:05.727394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:05.727394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:05.728685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:22:05.728685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:22:05.728685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:22:05.728685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:22:05.728685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:22:05.728685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:22:05.728685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:05.728685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: ERROR keystone.server.flask.application Sep 24 19:22:05.728685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 645/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Sat Sep 24 19:22:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:05.733299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30697772-c7a8-47f1-9f7b-7dcebf10c846 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:05.782647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:05.831815 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30697772-c7a8-47f1-9f7b-7dcebf10c846 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:05.864402 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9db2f-d7ec-4155-8d33-9b0ae1277c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:05.864990 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9db2f-d7ec-4155-8d33-9b0ae1277c4b None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:05.865268 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9db2f-d7ec-4155-8d33-9b0ae1277c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:05.865536 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9db2f-d7ec-4155-8d33-9b0ae1277c4b None admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:05.866213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9db2f-d7ec-4155-8d33-9b0ae1277c4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:05.866516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9db2f-d7ec-4155-8d33-9b0ae1277c4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:05.867956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9db2f-d7ec-4155-8d33-9b0ae1277c4b None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:05.880049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 641/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Sat Sep 24 19:22:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:05.885985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066df988-d23e-4d83-924a-48ed8704c455 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:05.983205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066df988-d23e-4d83-924a-48ed8704c455 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:06.015507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f48e7b-e9e8-4905-a7c0-f2f58f75aacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:06.016081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f48e7b-e9e8-4905-a7c0-f2f58f75aacf None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:06.016354 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f48e7b-e9e8-4905-a7c0-f2f58f75aacf None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:06.016620 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f48e7b-e9e8-4905-a7c0-f2f58f75aacf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:06.017318 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f48e7b-e9e8-4905-a7c0-f2f58f75aacf None admin] RBAC: Adding query filter params (role.id=dd27845a836a4f6ebece149dbebc59c0, scope.project.id=f61085f09512451e92c9fa36fa9a8071, user.id=95a375bda898420fb9df08d514bf9bff) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:06.017617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f48e7b-e9e8-4905-a7c0-f2f58f75aacf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:06.019103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f48e7b-e9e8-4905-a7c0-f2f58f75aacf None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:06.024809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 646/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Sat Sep 24 19:22:05 2022] GET /identity/v3/role_assignments?user.id=95a375bda898420fb9df08d514bf9bff&scope.project.id=f61085f09512451e92c9fa36fa9a8071&role.id=dd27845a836a4f6ebece149dbebc59c0 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:08.178138 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6649b66-c019-4ad5-a792-db06e9e6a1c9 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:08.178672 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6649b66-c019-4ad5-a792-db06e9e6a1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:08.178672 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6649b66-c019-4ad5-a792-db06e9e6a1c9 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:08.180067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 642/1288] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:08.185294 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330297f-0095-4c7c-8da6-444ca8667dd7 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:08.185695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330297f-0095-4c7c-8da6-444ca8667dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:08.185852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330297f-0095-4c7c-8da6-444ca8667dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:08.203708 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-5330297f-0095-4c7c-8da6-444ca8667dd7 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:08.204911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5330297f-0095-4c7c-8da6-444ca8667dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:08.234149 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:08.270391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 647/1289] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:22:08.536898 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6649b66-c019-4ad5-a792-db06e9e6a1c9 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:08.635570 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6649b66-c019-4ad5-a792-db06e9e6a1c9 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:08.646685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:08.670631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a8f19-5535-45c1-9dcd-69fe921ea986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:08.671276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a8f19-5535-45c1-9dcd-69fe921ea986 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:08.671552 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a8f19-5535-45c1-9dcd-69fe921ea986 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:08.671817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a8f19-5535-45c1-9dcd-69fe921ea986 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:08.672378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a8f19-5535-45c1-9dcd-69fe921ea986 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:08.673712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a8f19-5535-45c1-9dcd-69fe921ea986 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:08.683002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-0e0a8f19-5535-45c1-9dcd-69fe921ea986 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:22:08.683002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:08.683002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:22:08.683002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:22:08.683002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:22:08.683002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:22:08.683002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:22:08.683002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:08.683002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:22:08.683002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:22:08.683002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:08.683002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:22:08.683002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:08.683002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:08.683002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:08.683002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:08.683002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:08.684245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:08.684245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:08.684245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:08.684245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:08.684245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:08.684245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:08.684245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:22:08.684245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:22:08.684245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:22:08.684245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:22:08.684245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:08.684245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:08.684245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:08.684245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:08.684245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:08.684245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:08.685114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:08.685114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:08.685114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:08.685114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:08.685114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:08.685114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:08.685114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:08.685114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:08.685114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:08.685114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:08.685114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:22:08.685114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:08.685114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:22:08.685114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:22:08.685114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 643/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Sat Sep 24 19:22:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:08.690084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330297f-0095-4c7c-8da6-444ca8667dd7 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:08.786312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330297f-0095-4c7c-8da6-444ca8667dd7 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:08.818678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d50e32-b1f9-4966-9eb4-b7116d71684f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:08.819222 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d50e32-b1f9-4966-9eb4-b7116d71684f None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:08.819498 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d50e32-b1f9-4966-9eb4-b7116d71684f None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:08.819764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d50e32-b1f9-4966-9eb4-b7116d71684f None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:08.820369 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d50e32-b1f9-4966-9eb4-b7116d71684f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:08.820667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d50e32-b1f9-4966-9eb4-b7116d71684f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:08.822010 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d50e32-b1f9-4966-9eb4-b7116d71684f None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:08.826624 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 648/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Sat Sep 24 19:22:08 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:08.832727 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a8f19-5535-45c1-9dcd-69fe921ea986 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:08.930719 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a8f19-5535-45c1-9dcd-69fe921ea986 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:08.968881 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe466c-e543-46d6-b0b5-f558ba09816a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:08.969487 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe466c-e543-46d6-b0b5-f558ba09816a None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:08.969764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe466c-e543-46d6-b0b5-f558ba09816a None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:08.970037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe466c-e543-46d6-b0b5-f558ba09816a None admin] PATH_INFO: `/v3/services` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:08.970653 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe466c-e543-46d6-b0b5-f558ba09816a None admin] RBAC: Adding query filter params (type=placement) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:08.970986 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe466c-e543-46d6-b0b5-f558ba09816a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:08.972531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe466c-e543-46d6-b0b5-f558ba09816a None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:08.976908 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 644/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Sat Sep 24 19:22:08 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:11.163799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db75571-3b08-459e-99c7-e9cb309289a3 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:11.164332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db75571-3b08-459e-99c7-e9cb309289a3 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:11.164332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db75571-3b08-459e-99c7-e9cb309289a3 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:11.165645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 649/1293] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:11.170965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b578bbc-f8ca-4904-b26f-e9a8a36688d6 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:11.171349 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b578bbc-f8ca-4904-b26f-e9a8a36688d6 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:11.171527 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b578bbc-f8ca-4904-b26f-e9a8a36688d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:11.189566 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-9b578bbc-f8ca-4904-b26f-e9a8a36688d6 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:11.190971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-9b578bbc-f8ca-4904-b26f-e9a8a36688d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:11.220064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:11.256387 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 645/1294] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:22:11.529640 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db75571-3b08-459e-99c7-e9cb309289a3 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:11.560713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:11.628316 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db75571-3b08-459e-99c7-e9cb309289a3 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:11.660645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bcb59-5dbd-46d5-a37d-d7bbe2465a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:11.661222 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bcb59-5dbd-46d5-a37d-d7bbe2465a51 None admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:11.661493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bcb59-5dbd-46d5-a37d-d7bbe2465a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:11.661758 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bcb59-5dbd-46d5-a37d-d7bbe2465a51 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:11.662393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bcb59-5dbd-46d5-a37d-d7bbe2465a51 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:11.663758 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bcb59-5dbd-46d5-a37d-d7bbe2465a51 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:11.678886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 650/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Sat Sep 24 19:22:11 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:22:13.804188 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe211f4-dc2b-4045-9dfd-fbf5513be1eb None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:13.804816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe211f4-dc2b-4045-9dfd-fbf5513be1eb None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:13.804816 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe211f4-dc2b-4045-9dfd-fbf5513be1eb None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:13.806076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 646/1296] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:13.811501 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68fbe2-a768-4ea5-a114-da2df87bfebf None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:13.811913 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68fbe2-a768-4ea5-a114-da2df87bfebf None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:13.812054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68fbe2-a768-4ea5-a114-da2df87bfebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:13.830326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-0b68fbe2-a768-4ea5-a114-da2df87bfebf None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:13.832199 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-0b68fbe2-a768-4ea5-a114-da2df87bfebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:13.902699 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 651/1297] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:13 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:22:14.172871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe211f4-dc2b-4045-9dfd-fbf5513be1eb None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:14.271392 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe211f4-dc2b-4045-9dfd-fbf5513be1eb None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:14.304542 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabb00b-96b8-4066-a28a-90031c2217ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:14.305153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabb00b-96b8-4066-a28a-90031c2217ea None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:14.305442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabb00b-96b8-4066-a28a-90031c2217ea None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:14.305690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabb00b-96b8-4066-a28a-90031c2217ea None admin] PATH_INFO: `/v3/services/placement` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:14.306252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabb00b-96b8-4066-a28a-90031c2217ea None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:14.307615 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabb00b-96b8-4066-a28a-90031c2217ea None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:14.316276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-9eabb00b-96b8-4066-a28a-90031c2217ea None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:22:14.316276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:14.316276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:22:14.316276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:22:14.316276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:22:14.316276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:22:14.316276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:22:14.316276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:14.316276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:22:14.316276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:22:14.316276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:14.316276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:22:14.316276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:14.316276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:14.316276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:14.316276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:14.316276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:14.317534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:14.317534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:14.317534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:14.317534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:14.317534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:14.317534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:14.317534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:22:14.317534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:22:14.317534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:22:14.317534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:22:14.317534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:14.317534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:14.317534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:14.317534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:14.317534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:14.317534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:14.318608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:14.318608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:14.318608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:14.318608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:14.318608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:14.318608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:14.318608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:14.318608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:14.318608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:14.318608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:14.318608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:22:14.318608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:14.318608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:22:14.318608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:22:14.318608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 647/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Sat Sep 24 19:22:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:14.323218 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68fbe2-a768-4ea5-a114-da2df87bfebf None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:14.341649 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:14.420940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68fbe2-a768-4ea5-a114-da2df87bfebf None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:14.453849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d266db-db9e-4712-8870-5620b40d34d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:14.454387 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d266db-db9e-4712-8870-5620b40d34d1 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:14.454661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d266db-db9e-4712-8870-5620b40d34d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:14.454961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d266db-db9e-4712-8870-5620b40d34d1 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:14.456268 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d266db-db9e-4712-8870-5620b40d34d1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:14.456571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d266db-db9e-4712-8870-5620b40d34d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:14.457923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d266db-db9e-4712-8870-5620b40d34d1 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:14.462938 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 652/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Sat Sep 24 19:22:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:14.468967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabb00b-96b8-4066-a28a-90031c2217ea None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:14.499729 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:14.567086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabb00b-96b8-4066-a28a-90031c2217ea None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:14.599764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcf6f7-8ab5-43ed-a712-9a73020a6082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:14.600361 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcf6f7-8ab5-43ed-a712-9a73020a6082 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:14.600639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcf6f7-8ab5-43ed-a712-9a73020a6082 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:14.600911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcf6f7-8ab5-43ed-a712-9a73020a6082 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:14.601605 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadcf6f7-8ab5-43ed-a712-9a73020a6082 None admin] RBAC: Adding query filter params (interface=public, service_id=aec473b8118a48219775b6134c37dc36, region_id=RegionOne) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:14.601920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadcf6f7-8ab5-43ed-a712-9a73020a6082 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:14.603311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadcf6f7-8ab5-43ed-a712-9a73020a6082 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:14.608152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 648/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Sat Sep 24 19:22:14 2022] GET /identity/v3/endpoints?service_id=aec473b8118a48219775b6134c37dc36&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:14.613938 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d266db-db9e-4712-8870-5620b40d34d1 None admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:14.694794 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:14.712442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d266db-db9e-4712-8870-5620b40d34d1 None admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:14.746194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7053c-c372-430f-a444-67aa0f47cb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:14.746790 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7053c-c372-430f-a444-67aa0f47cb42 None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:14.747096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7053c-c372-430f-a444-67aa0f47cb42 None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:14.747369 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7053c-c372-430f-a444-67aa0f47cb42 None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:14.748003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7053c-c372-430f-a444-67aa0f47cb42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:14.749742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7053c-c372-430f-a444-67aa0f47cb42 None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:14.757030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 653/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Sat Sep 24 19:22:14 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:22:16.870148 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db60b03-8f2f-4dc2-8a6d-2c6ef0e5fbf6 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:16.870682 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db60b03-8f2f-4dc2-8a6d-2c6ef0e5fbf6 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:16.870682 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db60b03-8f2f-4dc2-8a6d-2c6ef0e5fbf6 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:16.872070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 649/1302] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:16.877100 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc330c1-d929-4ab5-ba41-621251f3d1e3 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:16.878031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc330c1-d929-4ab5-ba41-621251f3d1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:16.878176 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc330c1-d929-4ab5-ba41-621251f3d1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:16.896405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-6fc330c1-d929-4ab5-ba41-621251f3d1e3 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:16.897582 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6fc330c1-d929-4ab5-ba41-621251f3d1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:16.961163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 654/1303] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:16 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:22:17.226753 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db60b03-8f2f-4dc2-8a6d-2c6ef0e5fbf6 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:17.321089 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:17.328040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db60b03-8f2f-4dc2-8a6d-2c6ef0e5fbf6 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:17.361281 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e0caa-d9cb-472c-b520-25f48e1e9216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:17.361943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e0caa-d9cb-472c-b520-25f48e1e9216 None admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:17.362219 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e0caa-d9cb-472c-b520-25f48e1e9216 None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:17.362484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e0caa-d9cb-472c-b520-25f48e1e9216 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:17.363082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e0caa-d9cb-472c-b520-25f48e1e9216 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:17.364435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e0caa-d9cb-472c-b520-25f48e1e9216 None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:17.373029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application [None req-ba8e0caa-d9cb-472c-b520-25f48e1e9216 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:22:17.373029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:17.373029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:22:17.373029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:22:17.373029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:22:17.373029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:22:17.373029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:22:17.373029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:17.373029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:22:17.373029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:22:17.373029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:17.373029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:22:17.373029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:17.373029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:17.373029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:17.373029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:17.373029 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:17.374213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:17.374213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:17.374213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:17.374213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:17.374213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:17.374213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:17.374213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:22:17.374213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:22:17.374213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:22:17.374213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:22:17.374213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:17.374213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:17.374213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:17.374213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:17.374213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:17.374213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:17.375442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:17.375442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:17.375442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:17.375442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:17.375442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:17.375442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:17.375442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:17.375442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:17.375442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:17.375442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:17.375442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:22:17.375442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:17.375442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:22:17.375442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: ERROR keystone.server.flask.application Sep 24 19:22:17.375442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 650/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Sat Sep 24 19:22:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:17.380661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc330c1-d929-4ab5-ba41-621251f3d1e3 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:17.456638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:17.478692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc330c1-d929-4ab5-ba41-621251f3d1e3 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:17.511309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bed79c-dd5b-4687-802e-4d2e6f30d71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:17.511899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bed79c-dd5b-4687-802e-4d2e6f30d71d None admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:17.512175 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bed79c-dd5b-4687-802e-4d2e6f30d71d None admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:17.512443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bed79c-dd5b-4687-802e-4d2e6f30d71d None admin] PATH_INFO: `/v3/services` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:17.513051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bed79c-dd5b-4687-802e-4d2e6f30d71d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:17.513348 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bed79c-dd5b-4687-802e-4d2e6f30d71d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:17.514696 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bed79c-dd5b-4687-802e-4d2e6f30d71d None admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:17.520346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 655/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Sat Sep 24 19:22:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:17.526336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e0caa-d9cb-472c-b520-25f48e1e9216 None admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:17.623063 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e0caa-d9cb-472c-b520-25f48e1e9216 None admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:17.656382 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eb176-64fb-45d4-b3d8-b1031a9bcc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:17.656969 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eb176-64fb-45d4-b3d8-b1031a9bcc0e None admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:17.657246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eb176-64fb-45d4-b3d8-b1031a9bcc0e None admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:17.657518 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eb176-64fb-45d4-b3d8-b1031a9bcc0e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:17.658177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172eb176-64fb-45d4-b3d8-b1031a9bcc0e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:17.659586 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172eb176-64fb-45d4-b3d8-b1031a9bcc0e None admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:17.678223 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 651/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Sat Sep 24 19:22:17 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:22:27.516758 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=30 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:27.674186 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:22.223505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f361b71-6991-4c3f-9326-78c43bfaf652 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:22.224511 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f361b71-6991-4c3f-9326-78c43bfaf652 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:22.225013 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f361b71-6991-4c3f-9326-78c43bfaf652 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:22.226883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 656/1307] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:23:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:23:22.232530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b470cc5-af39-4c8f-8836-36ea985d4753 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:22.233043 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b470cc5-af39-4c8f-8836-36ea985d4753 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:22.233214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b470cc5-af39-4c8f-8836-36ea985d4753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:22.313622 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-7b470cc5-af39-4c8f-8836-36ea985d4753 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:23:22.314981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7b470cc5-af39-4c8f-8836-36ea985d4753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:22.431918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 652/1308] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:23:22.728731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901719b8-9a90-4ce7-81d3-eb98cc18ad84 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:22.729014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901719b8-9a90-4ce7-81d3-eb98cc18ad84 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:22.729530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901719b8-9a90-4ce7-81d3-eb98cc18ad84 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:22.730887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 657/1309] 10.222.0.25 () {54 vars in 964 bytes} [Sat Sep 24 19:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:23:22.737632 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14feb20-35c5-47ed-b28e-773589df95b0 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:22.737991 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14feb20-35c5-47ed-b28e-773589df95b0 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:22.738337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14feb20-35c5-47ed-b28e-773589df95b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:22.819487 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-c14feb20-35c5-47ed-b28e-773589df95b0 None None] MFA Rules not processed for user `1763ed41f99a4778b3df6eebcc6d94e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:23:22.820264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c14feb20-35c5-47ed-b28e-773589df95b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:22.844093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:22.908655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 653/1310] 10.222.0.25 () {58 vars in 1061 bytes} [Sat Sep 24 19:23:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:23:22.917587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901719b8-9a90-4ce7-81d3-eb98cc18ad84 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:23:22.919442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-901719b8-9a90-4ce7-81d3-eb98cc18ad84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:23.049116 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901719b8-9a90-4ce7-81d3-eb98cc18ad84 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:23:23.142511 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac65a6c-7984-494f-b565-44a1a7a08eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:23:23.143260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac65a6c-7984-494f-b565-44a1a7a08eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:23.143605 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac65a6c-7984-494f-b565-44a1a7a08eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:23.144170 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac65a6c-7984-494f-b565-44a1a7a08eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:23.146144 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7ac65a6c-7984-494f-b565-44a1a7a08eb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:23.213573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:23.280914 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac65a6c-7984-494f-b565-44a1a7a08eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:23:23.283877 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac65a6c-7984-494f-b565-44a1a7a08eb9 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:23:23.303701 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 658/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:23:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:23:25.840153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad452ef-65f5-49e4-ab3b-fb1dc1b83bc6 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:25.840719 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad452ef-65f5-49e4-ab3b-fb1dc1b83bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:25.840719 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad452ef-65f5-49e4-ab3b-fb1dc1b83bc6 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:25.842047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 654/1312] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:23:25.848117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe3951-ad54-402b-9f0e-133630db9042 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:25.848509 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe3951-ad54-402b-9f0e-133630db9042 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:25.848692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe3951-ad54-402b-9f0e-133630db9042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:25.928126 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-07fe3951-ad54-402b-9f0e-133630db9042 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:23:25.929360 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-07fe3951-ad54-402b-9f0e-133630db9042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:26.023470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 659/1313] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:23:26.303845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad452ef-65f5-49e4-ab3b-fb1dc1b83bc6 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:23:26.305462 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2ad452ef-65f5-49e4-ab3b-fb1dc1b83bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:26.410679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad452ef-65f5-49e4-ab3b-fb1dc1b83bc6 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:23:26.482027 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:26.485007 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03808da6-6c52-4385-af3d-147dfa3aec3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:23:26.485797 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03808da6-6c52-4385-af3d-147dfa3aec3c service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:26.486136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03808da6-6c52-4385-af3d-147dfa3aec3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:26.486605 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03808da6-6c52-4385-af3d-147dfa3aec3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:26.488543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-03808da6-6c52-4385-af3d-147dfa3aec3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:26.595734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03808da6-6c52-4385-af3d-147dfa3aec3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:23:26.597073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03808da6-6c52-4385-af3d-147dfa3aec3c service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:23:26.615077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 655/1314] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:23:29.097672 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d97b06-1057-4a28-b172-ce409c499433 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:29.098217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d97b06-1057-4a28-b172-ce409c499433 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:29.098333 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d97b06-1057-4a28-b172-ce409c499433 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:29.099639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 660/1315] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:23:29.104693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4020a-565a-4bee-a4cc-74963648928f None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:29.105103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4020a-565a-4bee-a4cc-74963648928f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:29.105244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4020a-565a-4bee-a4cc-74963648928f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:29.170726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-08a4020a-565a-4bee-a4cc-74963648928f None None] MFA Rules not processed for user `e80900aed4204d569a981d6b2e257d13`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:23:29.172585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-08a4020a-565a-4bee-a4cc-74963648928f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:29.223663 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:29.268575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 656/1316] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:23:29 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:23:29.553867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d97b06-1057-4a28-b172-ce409c499433 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:23:29.555453 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-73d97b06-1057-4a28-b172-ce409c499433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:29.566803 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:29.658438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d97b06-1057-4a28-b172-ce409c499433 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:23:29.733430 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555df92-f3b4-4422-abe3-126d2da42ec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:23:29.734032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555df92-f3b4-4422-abe3-126d2da42ec1 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:29.734957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555df92-f3b4-4422-abe3-126d2da42ec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:29.735123 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555df92-f3b4-4422-abe3-126d2da42ec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:29.736717 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-9555df92-f3b4-4422-abe3-126d2da42ec1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:29.803302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:29.849686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555df92-f3b4-4422-abe3-126d2da42ec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:23:29.851137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555df92-f3b4-4422-abe3-126d2da42ec1 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:23:29.869188 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 661/1317] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:23:29 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:23:32.569372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051d177-6644-4c34-a238-018054402c58 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:32.569907 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051d177-6644-4c34-a238-018054402c58 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:32.569907 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051d177-6644-4c34-a238-018054402c58 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:32.571286 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 657/1318] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:23:32.576589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fc203-bb2f-4d50-80d4-96fcbe862ecc None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:32.576966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fc203-bb2f-4d50-80d4-96fcbe862ecc None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:32.577138 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fc203-bb2f-4d50-80d4-96fcbe862ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:32.642766 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-1d5fc203-bb2f-4d50-80d4-96fcbe862ecc None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:23:32.643990 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1d5fc203-bb2f-4d50-80d4-96fcbe862ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:32.739157 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 662/1319] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:23:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:23:33.023060 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051d177-6644-4c34-a238-018054402c58 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:23:33.024866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-9051d177-6644-4c34-a238-018054402c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:33.127467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051d177-6644-4c34-a238-018054402c58 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:23:33.200253 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86fc493-dbc4-40c4-9322-ff5084019269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:23:33.200883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fc493-dbc4-40c4-9322-ff5084019269 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:33.201158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fc493-dbc4-40c4-9322-ff5084019269 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:33.201425 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86fc493-dbc4-40c4-9322-ff5084019269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:33.203694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f86fc493-dbc4-40c4-9322-ff5084019269 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:33.210448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:33.310572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fc493-dbc4-40c4-9322-ff5084019269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:23:33.311960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86fc493-dbc4-40c4-9322-ff5084019269 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:23:33.330354 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 658/1320] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:23:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:23:36.151467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb6653-cf4b-45b8-ad6d-447d079f1e1f None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:36.152005 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb6653-cf4b-45b8-ad6d-447d079f1e1f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:36.152005 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb6653-cf4b-45b8-ad6d-447d079f1e1f None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:36.153338 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 663/1321] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:23:36.158754 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b76cf-dc9a-4190-8a53-8e46da013434 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:36.159213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b76cf-dc9a-4190-8a53-8e46da013434 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:36.159391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b76cf-dc9a-4190-8a53-8e46da013434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:36.228284 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-127b76cf-dc9a-4190-8a53-8e46da013434 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:23:36.229557 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-127b76cf-dc9a-4190-8a53-8e46da013434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:36.296140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:36.339490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 659/1322] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:23:36.636450 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa13c4-634f-4281-b11e-3112ff8d8033 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:36.636759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa13c4-634f-4281-b11e-3112ff8d8033 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:36.637099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa13c4-634f-4281-b11e-3112ff8d8033 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:36.638499 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 664/1323] 10.222.0.25 () {54 vars in 964 bytes} [Sat Sep 24 19:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:23:36.644681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab09df0-8e40-4f17-9689-a5da59740fdb None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:36.644976 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab09df0-8e40-4f17-9689-a5da59740fdb None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:36.645286 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab09df0-8e40-4f17-9689-a5da59740fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:36.722363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-6ab09df0-8e40-4f17-9689-a5da59740fdb None None] MFA Rules not processed for user `1763ed41f99a4778b3df6eebcc6d94e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:23:36.723505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6ab09df0-8e40-4f17-9689-a5da59740fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:36.799868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 660/1324] 10.222.0.25 () {58 vars in 1061 bytes} [Sat Sep 24 19:23:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:23:36.809132 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa13c4-634f-4281-b11e-3112ff8d8033 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:23:36.810661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d3fa13c4-634f-4281-b11e-3112ff8d8033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:36.830189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:36.913927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa13c4-634f-4281-b11e-3112ff8d8033 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:23:36.987667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e450828-1a24-49ec-9b4e-59b5d5c680e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:23:36.988271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e450828-1a24-49ec-9b4e-59b5d5c680e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:36.988547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e450828-1a24-49ec-9b4e-59b5d5c680e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:36.988815 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e450828-1a24-49ec-9b4e-59b5d5c680e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:36.990391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4e450828-1a24-49ec-9b4e-59b5d5c680e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:37.066740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:37.105683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e450828-1a24-49ec-9b4e-59b5d5c680e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:23:37.107213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e450828-1a24-49ec-9b4e-59b5d5c680e3 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:23:37.125156 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 665/1325] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:23:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:23:39.578206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe74a4-5125-4d9e-88fc-3df02ed02e92 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:39.579049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe74a4-5125-4d9e-88fc-3df02ed02e92 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:39.579049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe74a4-5125-4d9e-88fc-3df02ed02e92 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:39.580033 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 661/1326] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:23:39.585542 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adde2f2-7f06-404e-bf7f-e6edd6e715f0 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:39.585950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adde2f2-7f06-404e-bf7f-e6edd6e715f0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:39.586085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adde2f2-7f06-404e-bf7f-e6edd6e715f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:39.652847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-4adde2f2-7f06-404e-bf7f-e6edd6e715f0 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:23:39.653949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4adde2f2-7f06-404e-bf7f-e6edd6e715f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:39.752760 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 666/1327] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:23:40.031896 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe74a4-5125-4d9e-88fc-3df02ed02e92 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:23:40.033437 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-adbe74a4-5125-4d9e-88fc-3df02ed02e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:40.094494 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:40.139106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe74a4-5125-4d9e-88fc-3df02ed02e92 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:23:40.211699 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d971d-cb7d-4a0c-aabd-b8fb06f5a4ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:23:40.212302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d971d-cb7d-4a0c-aabd-b8fb06f5a4ec service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:40.212578 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d971d-cb7d-4a0c-aabd-b8fb06f5a4ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:40.212851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d971d-cb7d-4a0c-aabd-b8fb06f5a4ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:40.214436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b38d971d-cb7d-4a0c-aabd-b8fb06f5a4ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:40.321527 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:40.323835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d971d-cb7d-4a0c-aabd-b8fb06f5a4ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:23:40.325858 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d971d-cb7d-4a0c-aabd-b8fb06f5a4ec service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:23:40.344685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 662/1328] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:23:42.593933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7cffa-1f9e-4162-9b36-f86bfa713122 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:42.594534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7cffa-1f9e-4162-9b36-f86bfa713122 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:42.594677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7cffa-1f9e-4162-9b36-f86bfa713122 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:42.596077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 667/1329] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:23:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:23:42.601902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3cec8-ff4f-4008-bba2-8213d221f4be None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:42.602369 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3cec8-ff4f-4008-bba2-8213d221f4be None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:42.602464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3cec8-ff4f-4008-bba2-8213d221f4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:42.674589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-6df3cec8-ff4f-4008-bba2-8213d221f4be None None] MFA Rules not processed for user `e80900aed4204d569a981d6b2e257d13`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:23:42.676115 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6df3cec8-ff4f-4008-bba2-8213d221f4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:42.775163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 663/1330] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:23:42 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:23:43.063814 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7cffa-1f9e-4162-9b36-f86bfa713122 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:23:43.065391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-43c7cffa-1f9e-4162-9b36-f86bfa713122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:43.098182 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:43.172051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7cffa-1f9e-4162-9b36-f86bfa713122 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:23:43.251035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3c813-3da6-4144-a515-f309cfb24270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:23:43.251639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3c813-3da6-4144-a515-f309cfb24270 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:43.251911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3c813-3da6-4144-a515-f309cfb24270 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:43.252173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3c813-3da6-4144-a515-f309cfb24270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:43.253764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4db3c813-3da6-4144-a515-f309cfb24270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:43.336113 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:43.368950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3c813-3da6-4144-a515-f309cfb24270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:23:43.370369 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3c813-3da6-4144-a515-f309cfb24270 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:23:43.388795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 668/1331] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:23:43 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:23:45.798964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d1b16-89a0-4227-a4f8-17326644c9ec None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:45.799545 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d1b16-89a0-4227-a4f8-17326644c9ec None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:45.799545 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d1b16-89a0-4227-a4f8-17326644c9ec None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:45.800906 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 664/1332] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:23:45.806049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335f59f-ed11-4ecc-81c2-8e00b2719e07 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:45.806502 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335f59f-ed11-4ecc-81c2-8e00b2719e07 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:45.806607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335f59f-ed11-4ecc-81c2-8e00b2719e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:45.871927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-e335f59f-ed11-4ecc-81c2-8e00b2719e07 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:23:45.873160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-e335f59f-ed11-4ecc-81c2-8e00b2719e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:45.969198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 669/1333] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:23:46.250763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d1b16-89a0-4227-a4f8-17326644c9ec None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:23:46.252344 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2d1d1b16-89a0-4227-a4f8-17326644c9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:46.322028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:46.355606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d1b16-89a0-4227-a4f8-17326644c9ec None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:23:46.429477 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c737a-98e9-4c9f-ba5f-333eda046344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:23:46.430083 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c737a-98e9-4c9f-ba5f-333eda046344 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:46.430361 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c737a-98e9-4c9f-ba5f-333eda046344 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:46.430631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c737a-98e9-4c9f-ba5f-333eda046344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:46.432247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7e6c737a-98e9-4c9f-ba5f-333eda046344 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:46.540019 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c737a-98e9-4c9f-ba5f-333eda046344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:23:46.541365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c737a-98e9-4c9f-ba5f-333eda046344 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:23:46.551679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:46.560693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 665/1334] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:23:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:23:48.741289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1812c9f-3488-4bf3-9ace-2ab5a9c27d87 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:48.741846 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1812c9f-3488-4bf3-9ace-2ab5a9c27d87 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:48.741846 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1812c9f-3488-4bf3-9ace-2ab5a9c27d87 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:48.743192 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 670/1335] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:23:48.748367 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c788760-d218-4032-b6d1-4372153530ce None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:48.748870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c788760-d218-4032-b6d1-4372153530ce None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:48.748974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c788760-d218-4032-b6d1-4372153530ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:48.815299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-0c788760-d218-4032-b6d1-4372153530ce None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:23:48.816505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-0c788760-d218-4032-b6d1-4372153530ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:48.911792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 666/1336] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:23:49.200656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1812c9f-3488-4bf3-9ace-2ab5a9c27d87 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:23:49.202230 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d1812c9f-3488-4bf3-9ace-2ab5a9c27d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:49.242102 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:49.305795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1812c9f-3488-4bf3-9ace-2ab5a9c27d87 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:23:49.378126 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c7fab-5574-4380-9915-b10956e63939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:23:49.378722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c7fab-5574-4380-9915-b10956e63939 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:49.379035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c7fab-5574-4380-9915-b10956e63939 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:49.379313 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c7fab-5574-4380-9915-b10956e63939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:49.380891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-876c7fab-5574-4380-9915-b10956e63939 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:49.465473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:49.492368 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c7fab-5574-4380-9915-b10956e63939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:23:49.493807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c7fab-5574-4380-9915-b10956e63939 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:23:49.511396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 671/1337] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:23:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:23:51.997453 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e401781-1f4c-4046-8405-f4b6e1d1316d None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:51.998026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e401781-1f4c-4046-8405-f4b6e1d1316d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:51.998026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e401781-1f4c-4046-8405-f4b6e1d1316d None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:52.000068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 667/1338] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:23:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:23:52.005792 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0efb9-ebec-49c9-8c6d-1274ff16bc45 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:52.006227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0efb9-ebec-49c9-8c6d-1274ff16bc45 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:52.006336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0efb9-ebec-49c9-8c6d-1274ff16bc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:52.071478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-2bb0efb9-ebec-49c9-8c6d-1274ff16bc45 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:23:52.072684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2bb0efb9-ebec-49c9-8c6d-1274ff16bc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:52.169655 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 672/1339] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:23:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:23:52.457998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e401781-1f4c-4046-8405-f4b6e1d1316d None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:23:52.459576 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7e401781-1f4c-4046-8405-f4b6e1d1316d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:52.537426 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:52.565336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e401781-1f4c-4046-8405-f4b6e1d1316d None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:23:52.638369 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bf49b-33f3-4607-9ef4-99a65fe8d5cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:23:52.639015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bf49b-33f3-4607-9ef4-99a65fe8d5cf service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:52.639293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bf49b-33f3-4607-9ef4-99a65fe8d5cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:52.640090 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bf49b-33f3-4607-9ef4-99a65fe8d5cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:52.642119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d95bf49b-33f3-4607-9ef4-99a65fe8d5cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:52.750434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bf49b-33f3-4607-9ef4-99a65fe8d5cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:23:52.751911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bf49b-33f3-4607-9ef4-99a65fe8d5cf service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:23:52.769982 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 668/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:23:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:23:56.860833 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9346a1-4239-4467-b3bd-cb6b6b6b0362 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:56.861350 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9346a1-4239-4467-b3bd-cb6b6b6b0362 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:56.861350 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9346a1-4239-4467-b3bd-cb6b6b6b0362 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:56.862700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 673/1341] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:23:56.868200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09243438-6b8d-4107-afab-62a78b7efca2 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:56.868634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09243438-6b8d-4107-afab-62a78b7efca2 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:56.868861 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09243438-6b8d-4107-afab-62a78b7efca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:56.874984 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:56.943383 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-09243438-6b8d-4107-afab-62a78b7efca2 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:23:56.944634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-09243438-6b8d-4107-afab-62a78b7efca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:57.048883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 669/1342] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:23:57.340015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9346a1-4239-4467-b3bd-cb6b6b6b0362 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:23:57.341539 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-fb9346a1-4239-4467-b3bd-cb6b6b6b0362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:57.390666 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:57.448669 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9346a1-4239-4467-b3bd-cb6b6b6b0362 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:23:57.523799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729aec73-6144-452d-af97-fd94ac19d6f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:23:57.524411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729aec73-6144-452d-af97-fd94ac19d6f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:23:57.524957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729aec73-6144-452d-af97-fd94ac19d6f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:23:57.525215 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729aec73-6144-452d-af97-fd94ac19d6f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:23:57.526804 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-729aec73-6144-452d-af97-fd94ac19d6f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:23:57.623552 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:57.641639 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729aec73-6144-452d-af97-fd94ac19d6f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:23:57.643108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729aec73-6144-452d-af97-fd94ac19d6f3 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:23:57.661903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 674/1343] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:23:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:24:00.510919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a5a70-38cc-4965-83d4-44cd71b53c52 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:00.511465 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a5a70-38cc-4965-83d4-44cd71b53c52 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:00.511465 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a5a70-38cc-4965-83d4-44cd71b53c52 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:00.512811 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 670/1344] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:00.518658 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e75dd-c23b-49ae-895a-1a65a6175350 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:00.519102 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e75dd-c23b-49ae-895a-1a65a6175350 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:00.519273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e75dd-c23b-49ae-895a-1a65a6175350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:00.585546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-b50e75dd-c23b-49ae-895a-1a65a6175350 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:00.586762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b50e75dd-c23b-49ae-895a-1a65a6175350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:00.690736 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 675/1345] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:24:00.975755 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a5a70-38cc-4965-83d4-44cd71b53c52 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:00.977354 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1b9a5a70-38cc-4965-83d4-44cd71b53c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:01.068302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:01.085992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a5a70-38cc-4965-83d4-44cd71b53c52 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:01.164168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224ce54-ae34-45a9-bc85-a3ae169f7e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:01.164779 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224ce54-ae34-45a9-bc85-a3ae169f7e15 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:01.165058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224ce54-ae34-45a9-bc85-a3ae169f7e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:01.165331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224ce54-ae34-45a9-bc85-a3ae169f7e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:01.166955 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6224ce54-ae34-45a9-bc85-a3ae169f7e15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:01.279163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224ce54-ae34-45a9-bc85-a3ae169f7e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:01.281275 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224ce54-ae34-45a9-bc85-a3ae169f7e15 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:01.299747 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 671/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:24:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:24:05.461160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1ae7b-83b0-46fa-be36-0aee1789da9a None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:05.461656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1ae7b-83b0-46fa-be36-0aee1789da9a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:05.461785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1ae7b-83b0-46fa-be36-0aee1789da9a None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:05.463180 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 676/1347] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:05.468859 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefdb8f-a961-4785-96f3-7ff4afced399 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:05.469326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefdb8f-a961-4785-96f3-7ff4afced399 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:05.469421 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefdb8f-a961-4785-96f3-7ff4afced399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:05.488140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:05.543525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-baefdb8f-a961-4785-96f3-7ff4afced399 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:05.544661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-baefdb8f-a961-4785-96f3-7ff4afced399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:05.650902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 672/1348] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:24:05.939100 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1ae7b-83b0-46fa-be36-0aee1789da9a None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:05.940666 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-88b1ae7b-83b0-46fa-be36-0aee1789da9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:05.998609 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:06.043780 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1ae7b-83b0-46fa-be36-0aee1789da9a None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:06.117893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e0d8d-d740-4ff9-b660-b7dc8c700d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:06.118406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e0d8d-d740-4ff9-b660-b7dc8c700d66 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:06.118683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e0d8d-d740-4ff9-b660-b7dc8c700d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:06.118988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e0d8d-d740-4ff9-b660-b7dc8c700d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:06.120587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-932e0d8d-d740-4ff9-b660-b7dc8c700d66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:06.227308 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:06.231486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e0d8d-d740-4ff9-b660-b7dc8c700d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:06.233429 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e0d8d-d740-4ff9-b660-b7dc8c700d66 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:06.252771 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 677/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:24:11.219445 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a36e0-c924-4c91-a180-0fc44bd5148f None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:11.219961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a36e0-c924-4c91-a180-0fc44bd5148f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:11.220149 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a36e0-c924-4c91-a180-0fc44bd5148f None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:11.221870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 673/1350] 10.222.0.25 () {54 vars in 921 bytes} [Sat Sep 24 19:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:11.227758 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d853a6-52f8-494e-9c4e-66e1fd0f45f0 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:11.228191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d853a6-52f8-494e-9c4e-66e1fd0f45f0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:11.230474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d853a6-52f8-494e-9c4e-66e1fd0f45f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:11.363887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-a7d853a6-52f8-494e-9c4e-66e1fd0f45f0 None None] MFA Rules not processed for user `95a375bda898420fb9df08d514bf9bff`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:11.365694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a7d853a6-52f8-494e-9c4e-66e1fd0f45f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:11.566091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 678/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Sat Sep 24 19:24:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:24:15.649096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=59 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:15.752281 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a61c3c-d08a-45e5-b167-60f23f9e0993 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:15.752684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a61c3c-d08a-45e5-b167-60f23f9e0993 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:15.752926 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a61c3c-d08a-45e5-b167-60f23f9e0993 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:15.754180 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 674/1352] 10.222.0.25 () {54 vars in 921 bytes} [Sat Sep 24 19:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:15.759417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da9ed9-18fb-4e68-8a5c-df2b01757d9a None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:15.759904 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da9ed9-18fb-4e68-8a5c-df2b01757d9a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:15.760178 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da9ed9-18fb-4e68-8a5c-df2b01757d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:15.817776 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:15.844025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-56da9ed9-18fb-4e68-8a5c-df2b01757d9a None None] MFA Rules not processed for user `95a375bda898420fb9df08d514bf9bff`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:15.845401 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-56da9ed9-18fb-4e68-8a5c-df2b01757d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:15.962993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 679/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Sat Sep 24 19:24:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:24:17.310562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf213fd-d80c-4e8e-a76b-f768b689eb86 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:17.312079 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf213fd-d80c-4e8e-a76b-f768b689eb86 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:17.312079 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf213fd-d80c-4e8e-a76b-f768b689eb86 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:17.313227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 675/1354] 10.222.0.25 () {54 vars in 921 bytes} [Sat Sep 24 19:24:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:17.318312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554b769-22b6-49b0-a520-3302ba5c61c1 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:17.318752 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554b769-22b6-49b0-a520-3302ba5c61c1 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:17.319031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554b769-22b6-49b0-a520-3302ba5c61c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:17.396275 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-8554b769-22b6-49b0-a520-3302ba5c61c1 None None] MFA Rules not processed for user `95a375bda898420fb9df08d514bf9bff`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:17.397560 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-8554b769-22b6-49b0-a520-3302ba5c61c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:17.441880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:17.508335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 680/1355] 10.222.0.25 () {58 vars in 1018 bytes} [Sat Sep 24 19:24:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:24:21.018379 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bf578-493a-41b0-ab75-7d033a5752f9 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:21.018947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bf578-493a-41b0-ab75-7d033a5752f9 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:21.019237 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bf578-493a-41b0-ab75-7d033a5752f9 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:21.020878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 676/1356] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:21.026537 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4275b-dac8-4ea5-a8cb-8fb7c655a6d4 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:21.027047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4275b-dac8-4ea5-a8cb-8fb7c655a6d4 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:21.027130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4275b-dac8-4ea5-a8cb-8fb7c655a6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:21.104332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-44e4275b-dac8-4ea5-a8cb-8fb7c655a6d4 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:21.105447 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-44e4275b-dac8-4ea5-a8cb-8fb7c655a6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:21.208112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 681/1357] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:24:21.521971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36dc0b-4d5f-4b82-9dbb-51069ae44f1b None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:21.522504 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36dc0b-4d5f-4b82-9dbb-51069ae44f1b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:21.523037 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36dc0b-4d5f-4b82-9dbb-51069ae44f1b None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:21.525774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 677/1358] 10.222.0.25 () {54 vars in 961 bytes} [Sat Sep 24 19:24:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:21.533825 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d2fe7-9cc1-4758-a584-636a2c1dc9cf None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:21.534645 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d2fe7-9cc1-4758-a584-636a2c1dc9cf None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:21.535971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d2fe7-9cc1-4758-a584-636a2c1dc9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:21.564908 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:21.640693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-a61d2fe7-9cc1-4758-a584-636a2c1dc9cf None None] MFA Rules not processed for user `4e5798be0fa544cf9cf48558e87fcfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:21.642035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a61d2fe7-9cc1-4758-a584-636a2c1dc9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:21.765266 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 682/1359] 10.222.0.25 () {58 vars in 1058 bytes} [Sat Sep 24 19:24:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:24:21.773175 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36dc0b-4d5f-4b82-9dbb-51069ae44f1b None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:21.775199 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4e36dc0b-4d5f-4b82-9dbb-51069ae44f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:21.936706 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36dc0b-4d5f-4b82-9dbb-51069ae44f1b None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:22.015245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:22.059621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2929998-5bd9-4767-a952-06c1510c9825 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:22.060316 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2929998-5bd9-4767-a952-06c1510c9825 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:22.060833 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2929998-5bd9-4767-a952-06c1510c9825 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:22.061410 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2929998-5bd9-4767-a952-06c1510c9825 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:22.063484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d2929998-5bd9-4767-a952-06c1510c9825 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:22.169456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2929998-5bd9-4767-a952-06c1510c9825 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:22.179035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2929998-5bd9-4767-a952-06c1510c9825 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:22.201751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 678/1360] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:24:24.583710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26549048-1ec4-4f58-9557-969be88b8153 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:24.584246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26549048-1ec4-4f58-9557-969be88b8153 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:24.584246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26549048-1ec4-4f58-9557-969be88b8153 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:24.585662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 683/1361] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:24.592892 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e34098-8582-43cc-9dda-a66255e97709 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:24.593457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e34098-8582-43cc-9dda-a66255e97709 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:24.593457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e34098-8582-43cc-9dda-a66255e97709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:24.670798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-50e34098-8582-43cc-9dda-a66255e97709 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:24.672069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-50e34098-8582-43cc-9dda-a66255e97709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:24.710781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:24.775153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 679/1362] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:24:25.068818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26549048-1ec4-4f58-9557-969be88b8153 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:25.070340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-26549048-1ec4-4f58-9557-969be88b8153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:25.150889 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:25.260075 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26549048-1ec4-4f58-9557-969be88b8153 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:25.389187 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6b5aa-d3b2-47c0-9a53-2fe8274ce2e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:25.389780 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6b5aa-d3b2-47c0-9a53-2fe8274ce2e3 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:25.390062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6b5aa-d3b2-47c0-9a53-2fe8274ce2e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:25.390330 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6b5aa-d3b2-47c0-9a53-2fe8274ce2e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:25.391941 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-9fd6b5aa-d3b2-47c0-9a53-2fe8274ce2e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:25.416789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:25.487336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6b5aa-d3b2-47c0-9a53-2fe8274ce2e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:25.489223 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6b5aa-d3b2-47c0-9a53-2fe8274ce2e3 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:25.507361 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 684/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:24:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:24:28.003204 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b12173-0069-45a8-b5dd-abe34fe59e69 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:28.003776 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b12173-0069-45a8-b5dd-abe34fe59e69 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:28.003776 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b12173-0069-45a8-b5dd-abe34fe59e69 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:28.005086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 680/1364] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:28.010431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68cbae-0f6c-4a4a-bd95-3fd1a357e079 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:28.010865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68cbae-0f6c-4a4a-bd95-3fd1a357e079 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:28.011014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68cbae-0f6c-4a4a-bd95-3fd1a357e079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:28.080242 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-9f68cbae-0f6c-4a4a-bd95-3fd1a357e079 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:28.081405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-9f68cbae-0f6c-4a4a-bd95-3fd1a357e079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:28.187876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:28.198861 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 685/1365] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:24:28.484744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc086cc1-aaa4-4a22-b0f4-e5c0eadc99df None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:28.485175 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc086cc1-aaa4-4a22-b0f4-e5c0eadc99df None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:28.485580 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc086cc1-aaa4-4a22-b0f4-e5c0eadc99df None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:28.487200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 681/1366] 10.222.0.25 () {54 vars in 961 bytes} [Sat Sep 24 19:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:28.492646 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140af94e-f32b-49b1-b320-ecd68ebae27e None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:28.492942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140af94e-f32b-49b1-b320-ecd68ebae27e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:28.493215 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140af94e-f32b-49b1-b320-ecd68ebae27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:28.573619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-140af94e-f32b-49b1-b320-ecd68ebae27e None None] MFA Rules not processed for user `4e5798be0fa544cf9cf48558e87fcfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:28.574806 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-140af94e-f32b-49b1-b320-ecd68ebae27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:28.696790 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 686/1367] 10.222.0.25 () {58 vars in 1058 bytes} [Sat Sep 24 19:24:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:24:28.705049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc086cc1-aaa4-4a22-b0f4-e5c0eadc99df None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:28.706549 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-cc086cc1-aaa4-4a22-b0f4-e5c0eadc99df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:28.862709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc086cc1-aaa4-4a22-b0f4-e5c0eadc99df None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:28.884053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:28.985948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7b315-0c95-4606-947d-a14877968c71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:28.986656 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7b315-0c95-4606-947d-a14877968c71 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:28.986961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7b315-0c95-4606-947d-a14877968c71 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:28.987236 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7b315-0c95-4606-947d-a14877968c71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:28.988841 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-49f7b315-0c95-4606-947d-a14877968c71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:29.083630 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7b315-0c95-4606-947d-a14877968c71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:29.085233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7b315-0c95-4606-947d-a14877968c71 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:29.105622 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 682/1368] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:24:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:24:29.291353 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf1975-2d5c-48bf-b1bf-f958580bd1d2 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:29.291898 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf1975-2d5c-48bf-b1bf-f958580bd1d2 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:29.291898 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf1975-2d5c-48bf-b1bf-f958580bd1d2 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:29.293348 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 687/1369] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:29.299473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405fabf-26fb-4d12-aded-89e1541baef2 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:29.299788 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405fabf-26fb-4d12-aded-89e1541baef2 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:29.300032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405fabf-26fb-4d12-aded-89e1541baef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:29.337058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:29.382049 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-c405fabf-26fb-4d12-aded-89e1541baef2 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:29.383319 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c405fabf-26fb-4d12-aded-89e1541baef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:29.501731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 683/1370] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:24:29.841110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35b4ea-5268-4fae-962c-6cf0eb138845 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:29.841110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35b4ea-5268-4fae-962c-6cf0eb138845 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:29.841110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35b4ea-5268-4fae-962c-6cf0eb138845 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:29.841110 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 688/1371] 10.222.0.25 () {54 vars in 963 bytes} [Sat Sep 24 19:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:29.846466 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc8c4b-aaaa-450a-a590-fe6a4a3f3c5d None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:29.846758 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc8c4b-aaaa-450a-a590-fe6a4a3f3c5d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:29.847156 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc8c4b-aaaa-450a-a590-fe6a4a3f3c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:29.931989 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-9efc8c4b-aaaa-450a-a590-fe6a4a3f3c5d None None] MFA Rules not processed for user `5840a13ddf8c45f2bf97a4f6d4a48d96`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:29.933468 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-9efc8c4b-aaaa-450a-a590-fe6a4a3f3c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:29.985192 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:30.018770 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 684/1372] 10.222.0.25 () {58 vars in 1060 bytes} [Sat Sep 24 19:24:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:24:30.026653 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35b4ea-5268-4fae-962c-6cf0eb138845 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:30.028312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-da35b4ea-5268-4fae-962c-6cf0eb138845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:30.086648 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:30.151627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35b4ea-5268-4fae-962c-6cf0eb138845 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:30.255051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bf2ce-534d-4933-a4fd-3596aec4753e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5840a13ddf8c45f2bf97a4f6d4a48d96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:30.255829 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bf2ce-534d-4933-a4fd-3596aec4753e service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:30.256215 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bf2ce-534d-4933-a4fd-3596aec4753e service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:30.257829 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bf2ce-534d-4933-a4fd-3596aec4753e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:30.259974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f52bf2ce-534d-4933-a4fd-3596aec4753e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:30.390621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:30.422099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52bf2ce-534d-4933-a4fd-3596aec4753e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:30.423313 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52bf2ce-534d-4933-a4fd-3596aec4753e service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:30.444574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 689/1373] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:24:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:24:31.355846 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b02a7-03f7-441a-8e85-327ffcdf1913 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:31.356407 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b02a7-03f7-441a-8e85-327ffcdf1913 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:31.356407 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b02a7-03f7-441a-8e85-327ffcdf1913 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:31.358306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 685/1374] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:24:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:31.363498 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ed506-557a-4b19-8931-34b3fad278b4 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:31.363785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ed506-557a-4b19-8931-34b3fad278b4 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:31.364204 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ed506-557a-4b19-8931-34b3fad278b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:31.433937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-2f1ed506-557a-4b19-8931-34b3fad278b4 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:31.436188 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2f1ed506-557a-4b19-8931-34b3fad278b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:31.541351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 690/1375] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:24:31.836906 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b02a7-03f7-441a-8e85-327ffcdf1913 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:31.838425 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a16b02a7-03f7-441a-8e85-327ffcdf1913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:32.001127 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b02a7-03f7-441a-8e85-327ffcdf1913 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:32.057709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:32.127391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce00c36-e594-43a6-a83d-796047c61ae3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:32.128130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce00c36-e594-43a6-a83d-796047c61ae3 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:32.128422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce00c36-e594-43a6-a83d-796047c61ae3 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:32.128718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce00c36-e594-43a6-a83d-796047c61ae3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:32.130317 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-3ce00c36-e594-43a6-a83d-796047c61ae3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:32.226299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce00c36-e594-43a6-a83d-796047c61ae3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:32.227940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce00c36-e594-43a6-a83d-796047c61ae3 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:32.246770 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 686/1376] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:24:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:24:34.503900 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c68ec4-fdc0-4e9d-9a83-b91cdcb828c5 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:34.504443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c68ec4-fdc0-4e9d-9a83-b91cdcb828c5 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:34.504443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c68ec4-fdc0-4e9d-9a83-b91cdcb828c5 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:34.505750 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 691/1377] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:34.511059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a06dec-936c-4e4b-a283-5054b6ad1a16 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:34.511503 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a06dec-936c-4e4b-a283-5054b6ad1a16 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:34.511584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a06dec-936c-4e4b-a283-5054b6ad1a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:34.584146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-17a06dec-936c-4e4b-a283-5054b6ad1a16 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:34.585337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-17a06dec-936c-4e4b-a283-5054b6ad1a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:34.592554 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:34.692733 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 687/1378] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:24:34.982302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c68ec4-fdc0-4e9d-9a83-b91cdcb828c5 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:34.984173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-15c68ec4-fdc0-4e9d-9a83-b91cdcb828c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:35.049538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:35.141649 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c68ec4-fdc0-4e9d-9a83-b91cdcb828c5 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:35.268060 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2deb4-8b7f-4db4-9a0b-7f71390caf57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:35.268664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2deb4-8b7f-4db4-9a0b-7f71390caf57 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:35.268939 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2deb4-8b7f-4db4-9a0b-7f71390caf57 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:35.269220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2deb4-8b7f-4db4-9a0b-7f71390caf57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:35.270967 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-51c2deb4-8b7f-4db4-9a0b-7f71390caf57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:35.291118 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:35.366046 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2deb4-8b7f-4db4-9a0b-7f71390caf57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:35.367668 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2deb4-8b7f-4db4-9a0b-7f71390caf57 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:35.386411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 692/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:24:37.618911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f1bb0-e425-47e2-b624-ba4e1d0e8b1b None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:37.619458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f1bb0-e425-47e2-b624-ba4e1d0e8b1b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:37.619458 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f1bb0-e425-47e2-b624-ba4e1d0e8b1b None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:37.620939 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 688/1380] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:37.626921 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ec5c1-c6ca-45e2-ac31-420e7920dfd1 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:37.627339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ec5c1-c6ca-45e2-ac31-420e7920dfd1 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:37.627451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ec5c1-c6ca-45e2-ac31-420e7920dfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:37.695799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-036ec5c1-c6ca-45e2-ac31-420e7920dfd1 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:37.696941 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-036ec5c1-c6ca-45e2-ac31-420e7920dfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:37.799410 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:37.808103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 693/1381] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:24:38.104938 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f1bb0-e425-47e2-b624-ba4e1d0e8b1b None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:38.106483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ea9f1bb0-e425-47e2-b624-ba4e1d0e8b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:38.265076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:38.277146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f1bb0-e425-47e2-b624-ba4e1d0e8b1b None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:38.411574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf75270-b949-4f82-ba6d-c26d645d6983 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:38.412457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf75270-b949-4f82-ba6d-c26d645d6983 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:38.412742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf75270-b949-4f82-ba6d-c26d645d6983 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:38.413014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf75270-b949-4f82-ba6d-c26d645d6983 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:38.414649 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7cf75270-b949-4f82-ba6d-c26d645d6983 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:38.516041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf75270-b949-4f82-ba6d-c26d645d6983 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:38.517678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf75270-b949-4f82-ba6d-c26d645d6983 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:38.528619 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:38.538118 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 689/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:24:41.145527 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e5e10-1a81-4b64-8ede-9c3776b61211 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:41.146079 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e5e10-1a81-4b64-8ede-9c3776b61211 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:41.146416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e5e10-1a81-4b64-8ede-9c3776b61211 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:41.147709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 694/1383] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:41.155383 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fcc3f-0a69-4a8d-98d7-7ce613fc9f58 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:41.156010 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fcc3f-0a69-4a8d-98d7-7ce613fc9f58 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:41.156010 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fcc3f-0a69-4a8d-98d7-7ce613fc9f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:41.234131 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-380fcc3f-0a69-4a8d-98d7-7ce613fc9f58 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:41.235430 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-380fcc3f-0a69-4a8d-98d7-7ce613fc9f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:41.344605 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 690/1384] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:24:41.707539 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e5e10-1a81-4b64-8ede-9c3776b61211 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:41.709483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d68e5e10-1a81-4b64-8ede-9c3776b61211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:41.876876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e5e10-1a81-4b64-8ede-9c3776b61211 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:41.953991 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:42.008251 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773bcd5-9b48-4009-ad4d-0df6c9c109c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:42.008855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773bcd5-9b48-4009-ad4d-0df6c9c109c3 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:42.009134 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773bcd5-9b48-4009-ad4d-0df6c9c109c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:42.009608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773bcd5-9b48-4009-ad4d-0df6c9c109c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:42.011142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2773bcd5-9b48-4009-ad4d-0df6c9c109c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:42.114681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773bcd5-9b48-4009-ad4d-0df6c9c109c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:42.116732 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773bcd5-9b48-4009-ad4d-0df6c9c109c3 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:42.139986 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 695/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:24:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:24:44.601712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096ed3b-ea9d-4743-afe9-4903e42a3123 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:44.602300 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096ed3b-ea9d-4743-afe9-4903e42a3123 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:44.602300 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096ed3b-ea9d-4743-afe9-4903e42a3123 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:44.603798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 691/1386] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:44.608959 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283be06-0c69-44f9-8bd9-3d3035793c60 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:44.609348 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283be06-0c69-44f9-8bd9-3d3035793c60 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:44.609502 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283be06-0c69-44f9-8bd9-3d3035793c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:44.676341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-c283be06-0c69-44f9-8bd9-3d3035793c60 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:44.677457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c283be06-0c69-44f9-8bd9-3d3035793c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:44.711143 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:44.777128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 696/1387] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:24:45.066183 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096ed3b-ea9d-4743-afe9-4903e42a3123 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:45.067777 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-9096ed3b-ea9d-4743-afe9-4903e42a3123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:45.145841 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:45.218210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096ed3b-ea9d-4743-afe9-4903e42a3123 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:45.334241 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380520e-9eef-474c-9331-83b7642a7dba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:45.334763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380520e-9eef-474c-9331-83b7642a7dba service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:45.335071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380520e-9eef-474c-9331-83b7642a7dba service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:45.335345 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380520e-9eef-474c-9331-83b7642a7dba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:45.336935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-0380520e-9eef-474c-9331-83b7642a7dba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:45.376165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:45.428952 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380520e-9eef-474c-9331-83b7642a7dba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:45.430565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380520e-9eef-474c-9331-83b7642a7dba service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:45.449234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 692/1388] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:24:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:24:45.742883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16988d6-9a2d-4dc5-b64c-b59bae15baf3 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:45.743428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16988d6-9a2d-4dc5-b64c-b59bae15baf3 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:45.743428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16988d6-9a2d-4dc5-b64c-b59bae15baf3 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:45.744947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 697/1389] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:45.750201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4ce1d-8898-45b6-8437-78026d35590d None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:45.750646 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4ce1d-8898-45b6-8437-78026d35590d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:45.750815 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4ce1d-8898-45b6-8437-78026d35590d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:45.819067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-d2b4ce1d-8898-45b6-8437-78026d35590d None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:45.820270 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d2b4ce1d-8898-45b6-8437-78026d35590d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:45.920449 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 693/1390] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:24:46.226063 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bff3ef-6915-43a1-8af5-500bebed6d7d None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:46.226348 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bff3ef-6915-43a1-8af5-500bebed6d7d None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:46.226621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bff3ef-6915-43a1-8af5-500bebed6d7d None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:46.227986 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 698/1391] 10.222.0.25 () {54 vars in 962 bytes} [Sat Sep 24 19:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:46.233582 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b19e4b-c92b-42fe-9a1a-c8592983e5da None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:46.233864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b19e4b-c92b-42fe-9a1a-c8592983e5da None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:46.234132 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b19e4b-c92b-42fe-9a1a-c8592983e5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:46.250431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:46.311955 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-31b19e4b-c92b-42fe-9a1a-c8592983e5da None None] MFA Rules not processed for user `54232cb318b04e9286f58dae8b2a3fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:46.313139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-31b19e4b-c92b-42fe-9a1a-c8592983e5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:46.392915 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 694/1392] 10.222.0.25 () {58 vars in 1059 bytes} [Sat Sep 24 19:24:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:24:46.401058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bff3ef-6915-43a1-8af5-500bebed6d7d None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:46.402672 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-75bff3ef-6915-43a1-8af5-500bebed6d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:46.509118 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bff3ef-6915-43a1-8af5-500bebed6d7d None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:46.569058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:46.584947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ca0de-8efd-4060-9ac2-7e17606be6b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54232cb318b04e9286f58dae8b2a3fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:46.585547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ca0de-8efd-4060-9ac2-7e17606be6b8 service glance] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:46.585824 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ca0de-8efd-4060-9ac2-7e17606be6b8 service glance] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:46.586093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ca0de-8efd-4060-9ac2-7e17606be6b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:46.587701 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-994ca0de-8efd-4060-9ac2-7e17606be6b8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:46.699791 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ca0de-8efd-4060-9ac2-7e17606be6b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:46.701258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ca0de-8efd-4060-9ac2-7e17606be6b8 service glance] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:46.719727 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 699/1393] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:24:47.508097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068d449-c368-436b-8a0d-aa74ceba0759 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:47.508612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068d449-c368-436b-8a0d-aa74ceba0759 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:47.508729 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068d449-c368-436b-8a0d-aa74ceba0759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:47.581404 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-7068d449-c368-436b-8a0d-aa74ceba0759 None None] MFA Rules not processed for user `7c398cf6318240f09d2c3b62bc6761d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:47.582722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7068d449-c368-436b-8a0d-aa74ceba0759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:47.642448 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:47.675387 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 695/1394] 10.222.0.25 () {58 vars in 1009 bytes} [Sat Sep 24 19:24:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:24:47.695755 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d8654-bf23-48eb-9836-d11540cc1d99 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:47.696219 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d8654-bf23-48eb-9836-d11540cc1d99 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:47.696322 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d8654-bf23-48eb-9836-d11540cc1d99 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:47.697882 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 700/1395] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:47.703532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f929de-8cf8-4c09-8ebf-c8e106f9c01a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:47.703823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f929de-8cf8-4c09-8ebf-c8e106f9c01a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:47.704099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f929de-8cf8-4c09-8ebf-c8e106f9c01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:47.721943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abf2aa-bb23-463e-a39f-0cb19eb6fd00 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:47.722315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abf2aa-bb23-463e-a39f-0cb19eb6fd00 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:47.722650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abf2aa-bb23-463e-a39f-0cb19eb6fd00 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:47.724202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 701/1396] 10.222.0.25 () {54 vars in 943 bytes} [Sat Sep 24 19:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:47.730516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5122172-a2f9-45e6-904b-9b4d557e18e7 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:47.730897 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5122172-a2f9-45e6-904b-9b4d557e18e7 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:47.731241 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5122172-a2f9-45e6-904b-9b4d557e18e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:47.776238 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-51f929de-8cf8-4c09-8ebf-c8e106f9c01a None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:47.777512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-51f929de-8cf8-4c09-8ebf-c8e106f9c01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:47.809603 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-c5122172-a2f9-45e6-904b-9b4d557e18e7 None None] MFA Rules not processed for user `85b45de73f7b4f7da7e0e8d8375deb37`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:47.810896 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c5122172-a2f9-45e6-904b-9b4d557e18e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:47.844418 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:47.877450 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 696/1397] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:24:47.920756 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 702/1398] 10.222.0.25 () {58 vars in 1040 bytes} [Sat Sep 24 19:24:47 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:24:47.929995 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f929de-8cf8-4c09-8ebf-c8e106f9c01a None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:47.931249 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-51f929de-8cf8-4c09-8ebf-c8e106f9c01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:47.984148 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:48.036118 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f929de-8cf8-4c09-8ebf-c8e106f9c01a None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:48.144117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313244b4-a69b-49bd-98c9-d3d3bb341591 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85b45de73f7b4f7da7e0e8d8375deb37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:48.144718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313244b4-a69b-49bd-98c9-d3d3bb341591 service swift] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:48.144992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313244b4-a69b-49bd-98c9-d3d3bb341591 service swift] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:48.145262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313244b4-a69b-49bd-98c9-d3d3bb341591 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:48.146913 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-313244b4-a69b-49bd-98c9-d3d3bb341591 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:48.170650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5122172-a2f9-45e6-904b-9b4d557e18e7 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:48.171868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c5122172-a2f9-45e6-904b-9b4d557e18e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:48.219301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:48.236488 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313244b4-a69b-49bd-98c9-d3d3bb341591 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:48.238070 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313244b4-a69b-49bd-98c9-d3d3bb341591 service swift] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:48.245997 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 697/1399] 10.222.0.25 () {60 vars in 1384 bytes} [Sat Sep 24 19:24:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 19:24:48.272191 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5122172-a2f9-45e6-904b-9b4d557e18e7 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:48.328673 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:48.413785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82919b4c-3bb4-40d9-badd-3ed961674058 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:48.415542 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82919b4c-3bb4-40d9-badd-3ed961674058 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:48.416147 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82919b4c-3bb4-40d9-badd-3ed961674058 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:48.416593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82919b4c-3bb4-40d9-badd-3ed961674058 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:48.418321 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-82919b4c-3bb4-40d9-badd-3ed961674058 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:48.647507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82919b4c-3bb4-40d9-badd-3ed961674058 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:48.649407 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82919b4c-3bb4-40d9-badd-3ed961674058 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:48.683018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 703/1400] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:24:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:24:50.911920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121e5ff-a912-4147-bf74-97d29883c90d None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:50.913064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121e5ff-a912-4147-bf74-97d29883c90d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:50.913539 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121e5ff-a912-4147-bf74-97d29883c90d None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:50.915152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 698/1401] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:24:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:50.920789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47ff8e-fca6-4f4b-ad7c-642337dbe2c7 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:50.921252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47ff8e-fca6-4f4b-ad7c-642337dbe2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:50.921485 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47ff8e-fca6-4f4b-ad7c-642337dbe2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:51.000203 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-1c47ff8e-fca6-4f4b-ad7c-642337dbe2c7 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:51.001438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1c47ff8e-fca6-4f4b-ad7c-642337dbe2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:51.009817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:51.110309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 704/1402] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:24:51.400104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121e5ff-a912-4147-bf74-97d29883c90d None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:51.401862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-5121e5ff-a912-4147-bf74-97d29883c90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:51.575285 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121e5ff-a912-4147-bf74-97d29883c90d None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:51.639895 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:51.703786 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea962406-917e-4c5f-b378-a2383a6e1605 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:51.704623 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea962406-917e-4c5f-b378-a2383a6e1605 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:51.704900 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea962406-917e-4c5f-b378-a2383a6e1605 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:51.705168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea962406-917e-4c5f-b378-a2383a6e1605 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:51.706783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ea962406-917e-4c5f-b378-a2383a6e1605 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:51.804466 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea962406-917e-4c5f-b378-a2383a6e1605 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:51.806062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea962406-917e-4c5f-b378-a2383a6e1605 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:51.827151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 699/1403] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:24:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:24:54.039381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c34f61-1005-4d77-9421-0e8880dffa5f None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:54.039969 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c34f61-1005-4d77-9421-0e8880dffa5f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:54.039969 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c34f61-1005-4d77-9421-0e8880dffa5f None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:54.041377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 705/1404] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:54.047239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e23392-f2b3-44f7-acde-257f83c88755 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:54.047693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e23392-f2b3-44f7-acde-257f83c88755 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:54.047693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e23392-f2b3-44f7-acde-257f83c88755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:54.127638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-63e23392-f2b3-44f7-acde-257f83c88755 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:54.128857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-63e23392-f2b3-44f7-acde-257f83c88755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:54.149484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:54.242902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 700/1405] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:24:54.540132 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c34f61-1005-4d77-9421-0e8880dffa5f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:54.541698 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-45c34f61-1005-4d77-9421-0e8880dffa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:54.710424 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:54.718022 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c34f61-1005-4d77-9421-0e8880dffa5f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:54.841829 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d06805-8512-4e63-99d0-0ed9fcbe85b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:54.842867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d06805-8512-4e63-99d0-0ed9fcbe85b6 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:54.843326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d06805-8512-4e63-99d0-0ed9fcbe85b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:54.843754 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d06805-8512-4e63-99d0-0ed9fcbe85b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:54.845514 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-08d06805-8512-4e63-99d0-0ed9fcbe85b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:54.947681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d06805-8512-4e63-99d0-0ed9fcbe85b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:54.949279 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d06805-8512-4e63-99d0-0ed9fcbe85b6 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:54.967755 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:54.973563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 706/1406] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:24:57.211097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd791c2c-ed71-4baf-a606-07d881969955 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:57.211667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd791c2c-ed71-4baf-a606-07d881969955 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:57.211667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd791c2c-ed71-4baf-a606-07d881969955 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:57.212966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 701/1407] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:57.218785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f0701-0c70-4228-a891-efffc5cd885a None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:57.219296 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f0701-0c70-4228-a891-efffc5cd885a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:57.219392 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f0701-0c70-4228-a891-efffc5cd885a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:57.293532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-d38f0701-0c70-4228-a891-efffc5cd885a None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:57.295007 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d38f0701-0c70-4228-a891-efffc5cd885a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:57.410934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 707/1408] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:24:57.696305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd791c2c-ed71-4baf-a606-07d881969955 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:57.697836 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-cd791c2c-ed71-4baf-a606-07d881969955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:57.857635 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd791c2c-ed71-4baf-a606-07d881969955 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:57.861428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:57.984634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5525f2c-add1-4a28-99e3-611f58794e4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:57.985240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5525f2c-add1-4a28-99e3-611f58794e4b service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:57.985522 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5525f2c-add1-4a28-99e3-611f58794e4b service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:57.985794 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5525f2c-add1-4a28-99e3-611f58794e4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:57.987438 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d5525f2c-add1-4a28-99e3-611f58794e4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:58.090945 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5525f2c-add1-4a28-99e3-611f58794e4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:58.093551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5525f2c-add1-4a28-99e3-611f58794e4b service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:58.112449 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 702/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:25:07.402242 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=66 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:08.110114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:11.297891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d4fa0-4a36-43b1-bb87-a89b0c5a25c0 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:11.298446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d4fa0-4a36-43b1-bb87-a89b0c5a25c0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:11.298446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d4fa0-4a36-43b1-bb87-a89b0c5a25c0 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:11.299809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 708/1410] 10.222.0.25 () {54 vars in 918 bytes} [Sat Sep 24 19:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:25:11.304924 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d84963-69bb-43e4-bf54-530c9042fd5a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:11.305380 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d84963-69bb-43e4-bf54-530c9042fd5a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:11.305490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d84963-69bb-43e4-bf54-530c9042fd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:11.381523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-91d84963-69bb-43e4-bf54-530c9042fd5a None None] MFA Rules not processed for user `95a375bda898420fb9df08d514bf9bff`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:11.382740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-91d84963-69bb-43e4-bf54-530c9042fd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:11.492041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 703/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Sat Sep 24 19:25:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:25:11.507926 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c0140-d552-4cb3-983b-2f637f16757a None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:11.508259 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c0140-d552-4cb3-983b-2f637f16757a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:11.508607 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c0140-d552-4cb3-983b-2f637f16757a None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:11.510129 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 709/1412] 10.222.0.25 () {54 vars in 918 bytes} [Sat Sep 24 19:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:25:11.515541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d0661-8811-4367-8777-fff91a020d96 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:11.515827 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d0661-8811-4367-8777-fff91a020d96 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:11.516129 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d0661-8811-4367-8777-fff91a020d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:11.589562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:11.594428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-5b1d0661-8811-4367-8777-fff91a020d96 None None] MFA Rules not processed for user `4e5798be0fa544cf9cf48558e87fcfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:11.595247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-5b1d0661-8811-4367-8777-fff91a020d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:11.712368 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 704/1413] 10.222.0.25 () {58 vars in 1015 bytes} [Sat Sep 24 19:25:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:25:14.318104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6523a2b-f6bf-40a1-8941-362b452f1731 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:14.318650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6523a2b-f6bf-40a1-8941-362b452f1731 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:14.318650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6523a2b-f6bf-40a1-8941-362b452f1731 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:14.319993 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:25:14.325550 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601f57c-bc37-407c-8d11-cb94baa57f68 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:14.326190 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601f57c-bc37-407c-8d11-cb94baa57f68 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:14.326190 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601f57c-bc37-407c-8d11-cb94baa57f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:14.393568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-a601f57c-bc37-407c-8d11-cb94baa57f68 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:14.394784 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a601f57c-bc37-407c-8d11-cb94baa57f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:14.453666 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:14.497162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:25:14.796230 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6523a2b-f6bf-40a1-8941-362b452f1731 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:25:14.797756 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d6523a2b-f6bf-40a1-8941-362b452f1731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:14.949763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6523a2b-f6bf-40a1-8941-362b452f1731 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:25:15.029103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:15.069286 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb208fb1-333d-4864-98f9-e2f76500565c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:25:15.069888 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb208fb1-333d-4864-98f9-e2f76500565c service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:15.070166 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb208fb1-333d-4864-98f9-e2f76500565c service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:15.070434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb208fb1-333d-4864-98f9-e2f76500565c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:15.072061 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-cb208fb1-333d-4864-98f9-e2f76500565c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:15.171422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb208fb1-333d-4864-98f9-e2f76500565c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:25:15.173271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb208fb1-333d-4864-98f9-e2f76500565c service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:25:15.194570 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 711/1416] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:25:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:25:16.342502 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7c14d-4576-4f1e-9979-a94a4677ecbd None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:16.343122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7c14d-4576-4f1e-9979-a94a4677ecbd None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:16.343122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7c14d-4576-4f1e-9979-a94a4677ecbd None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:16.344460 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:25:16.350726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf452466-3e8f-4372-98c3-de0ef7e1ead5 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:16.351158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf452466-3e8f-4372-98c3-de0ef7e1ead5 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:16.351305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf452466-3e8f-4372-98c3-de0ef7e1ead5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:16.426878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-bf452466-3e8f-4372-98c3-de0ef7e1ead5 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:16.428084 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-bf452466-3e8f-4372-98c3-de0ef7e1ead5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:16.455606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:16.525276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:25:16.676034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7c14d-4576-4f1e-9979-a94a4677ecbd None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:25:16.677620 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-86b7c14d-4576-4f1e-9979-a94a4677ecbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:16.821432 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7c14d-4576-4f1e-9979-a94a4677ecbd None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:25:16.861338 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:16.933695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a737238-76da-4e9f-b654-16cf7102f5e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:25:16.934216 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a737238-76da-4e9f-b654-16cf7102f5e1 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:16.935014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a737238-76da-4e9f-b654-16cf7102f5e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:16.935283 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a737238-76da-4e9f-b654-16cf7102f5e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:16.936863 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-5a737238-76da-4e9f-b654-16cf7102f5e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:17.027130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a737238-76da-4e9f-b654-16cf7102f5e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:25:17.028757 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a737238-76da-4e9f-b654-16cf7102f5e1 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:25:17.046891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 707/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:25:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:25:18.188166 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37ac5c-2a0d-48b3-ab49-84a957cf1dc1 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:18.188716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37ac5c-2a0d-48b3-ab49-84a957cf1dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:18.188815 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37ac5c-2a0d-48b3-ab49-84a957cf1dc1 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:18.190123 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:25:18.196483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab995e23-4a66-447c-b2d9-9de830fa98f4 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:18.196936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab995e23-4a66-447c-b2d9-9de830fa98f4 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:18.197044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab995e23-4a66-447c-b2d9-9de830fa98f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:18.251207 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:18.273806 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-ab995e23-4a66-447c-b2d9-9de830fa98f4 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:18.275054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ab995e23-4a66-447c-b2d9-9de830fa98f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:18.371174 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:25:18.522377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37ac5c-2a0d-48b3-ab49-84a957cf1dc1 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:25:18.523933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-cd37ac5c-2a0d-48b3-ab49-84a957cf1dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:18.672711 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37ac5c-2a0d-48b3-ab49-84a957cf1dc1 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:25:18.685843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:18.787146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9b1f5-a1db-48f9-83af-b7f12c7bfa6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:25:18.787669 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9b1f5-a1db-48f9-83af-b7f12c7bfa6d service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:18.787957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9b1f5-a1db-48f9-83af-b7f12c7bfa6d service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:18.788214 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9b1f5-a1db-48f9-83af-b7f12c7bfa6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:18.789834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-63a9b1f5-a1db-48f9-83af-b7f12c7bfa6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:18.879346 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9b1f5-a1db-48f9-83af-b7f12c7bfa6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:25:18.880925 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9b1f5-a1db-48f9-83af-b7f12c7bfa6d service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:25:18.898503 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 714/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:25:20.010463 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f60f7-3b21-485f-a075-594b90c04076 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:20.011106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f60f7-3b21-485f-a075-594b90c04076 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:20.011106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f60f7-3b21-485f-a075-594b90c04076 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:20.012957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:25:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:25:20.019457 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d9d98-b0c0-4724-8fe0-18b8c5f8f972 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:20.019890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d9d98-b0c0-4724-8fe0-18b8c5f8f972 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:20.020006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d9d98-b0c0-4724-8fe0-18b8c5f8f972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:20.040279 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:20.096417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-969d9d98-b0c0-4724-8fe0-18b8c5f8f972 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:20.097676 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-969d9d98-b0c0-4724-8fe0-18b8c5f8f972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:20.192616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:25:20.344974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f60f7-3b21-485f-a075-594b90c04076 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:25:20.346538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-3b9f60f7-3b21-485f-a075-594b90c04076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:20.456235 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:20.491254 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f60f7-3b21-485f-a075-594b90c04076 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:25:20.604422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643f186-1a09-4416-950c-f8b7d891d24b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:25:20.604961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643f186-1a09-4416-950c-f8b7d891d24b service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:20.605237 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643f186-1a09-4416-950c-f8b7d891d24b service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:20.605506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643f186-1a09-4416-950c-f8b7d891d24b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:20.607332 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a643f186-1a09-4416-950c-f8b7d891d24b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:20.684001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:20.698449 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643f186-1a09-4416-950c-f8b7d891d24b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:25:20.700622 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643f186-1a09-4416-950c-f8b7d891d24b service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:25:20.718269 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 710/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:25:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:25:21.840141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04dba0-8fee-4227-a70e-bc692f5faeb6 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:21.841474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04dba0-8fee-4227-a70e-bc692f5faeb6 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:21.841474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04dba0-8fee-4227-a70e-bc692f5faeb6 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:21.842620 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:25:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:25:21.848903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4c914-7df8-4608-8024-87374808c8fc None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:21.849362 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4c914-7df8-4608-8024-87374808c8fc None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:21.849468 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4c914-7df8-4608-8024-87374808c8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:21.925658 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-70d4c914-7df8-4608-8024-87374808c8fc None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:21.926856 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-70d4c914-7df8-4608-8024-87374808c8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:22.023307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:25:22.174585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04dba0-8fee-4227-a70e-bc692f5faeb6 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:25:22.176064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-aa04dba0-8fee-4227-a70e-bc692f5faeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:22.261878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:22.323580 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04dba0-8fee-4227-a70e-bc692f5faeb6 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:25:22.435773 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685a0a3-3ff8-4fc9-93a3-975e41dbc948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:25:22.436316 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685a0a3-3ff8-4fc9-93a3-975e41dbc948 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:22.436587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685a0a3-3ff8-4fc9-93a3-975e41dbc948 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:22.436848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685a0a3-3ff8-4fc9-93a3-975e41dbc948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:22.438416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d685a0a3-3ff8-4fc9-93a3-975e41dbc948 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:22.486218 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:22.528202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685a0a3-3ff8-4fc9-93a3-975e41dbc948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:25:22.529911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685a0a3-3ff8-4fc9-93a3-975e41dbc948 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:25:22.548100 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 717/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:25:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:25:23.606627 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1e27a-59e7-4e1b-83ab-3eed521c224e None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:23.607121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1e27a-59e7-4e1b-83ab-3eed521c224e None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:23.607378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1e27a-59e7-4e1b-83ab-3eed521c224e None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:23.608731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:25:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:25:23.614930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b502d1-edb8-46cf-a4c2-7756207aea2b None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:23.615413 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b502d1-edb8-46cf-a4c2-7756207aea2b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:23.615525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b502d1-edb8-46cf-a4c2-7756207aea2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:23.691891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-b2b502d1-edb8-46cf-a4c2-7756207aea2b None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:23.693009 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b2b502d1-edb8-46cf-a4c2-7756207aea2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:23.790444 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:25:23.940554 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1e27a-59e7-4e1b-83ab-3eed521c224e None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:25:23.942166 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-3ab1e27a-59e7-4e1b-83ab-3eed521c224e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:23.995505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:24.095835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1e27a-59e7-4e1b-83ab-3eed521c224e None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:25:24.208428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4e0d2-5f4b-416c-be16-01781991c753 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:25:24.208957 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4e0d2-5f4b-416c-be16-01781991c753 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:24.209236 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4e0d2-5f4b-416c-be16-01781991c753 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:24.209506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4e0d2-5f4b-416c-be16-01781991c753 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:24.211138 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-aad4e0d2-5f4b-416c-be16-01781991c753 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:24.218275 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:24.301055 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4e0d2-5f4b-416c-be16-01781991c753 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:25:24.302647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4e0d2-5f4b-416c-be16-01781991c753 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:25:24.320938 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 713/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:25:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:25:25.377901 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89486df-e731-4364-869b-883f78800e2a None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:25.378483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89486df-e731-4364-869b-883f78800e2a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:25.378483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89486df-e731-4364-869b-883f78800e2a None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:25.379849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:25:25.386006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fe1fa-5913-4564-894b-de2a8b963342 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:25.386417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fe1fa-5913-4564-894b-de2a8b963342 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:25.386584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fe1fa-5913-4564-894b-de2a8b963342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:25.462997 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-1d5fe1fa-5913-4564-894b-de2a8b963342 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:25.464195 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1d5fe1fa-5913-4564-894b-de2a8b963342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:25.531789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:25.560099 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:25:25.710565 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89486df-e731-4364-869b-883f78800e2a None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:25:25.712095 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f89486df-e731-4364-869b-883f78800e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:25.729315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:25.856697 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89486df-e731-4364-869b-883f78800e2a None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:25:25.944211 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:25.970247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e5e14-f2b6-42a5-b38b-7cfb6c8a7501 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:25:25.970782 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e5e14-f2b6-42a5-b38b-7cfb6c8a7501 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:25.971091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e5e14-f2b6-42a5-b38b-7cfb6c8a7501 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:25.971538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e5e14-f2b6-42a5-b38b-7cfb6c8a7501 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:25.972937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a57e5e14-f2b6-42a5-b38b-7cfb6c8a7501 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:26.062802 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e5e14-f2b6-42a5-b38b-7cfb6c8a7501 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:25:26.064393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e5e14-f2b6-42a5-b38b-7cfb6c8a7501 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:25:26.082020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 720/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:25:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:25:27.136586 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b0c3b-1f5c-4775-a5bf-aa6c829bacea None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:27.136586 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b0c3b-1f5c-4775-a5bf-aa6c829bacea None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:27.137113 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b0c3b-1f5c-4775-a5bf-aa6c829bacea None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:27.139043 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:25:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:25:27.145690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3185b-377c-418c-b77e-53fdbae61155 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:27.146138 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3185b-377c-418c-b77e-53fdbae61155 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:27.146241 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3185b-377c-418c-b77e-53fdbae61155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:27.222986 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-06b3185b-377c-418c-b77e-53fdbae61155 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:27.224199 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-06b3185b-377c-418c-b77e-53fdbae61155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:27.266177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:27.321725 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:25:27.474351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b0c3b-1f5c-4775-a5bf-aa6c829bacea None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:25:27.475927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-528b0c3b-1f5c-4775-a5bf-aa6c829bacea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:27.623623 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b0c3b-1f5c-4775-a5bf-aa6c829bacea None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:25:27.678044 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:27.736495 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbeba6-885d-4307-8042-1a1aa5eb3d0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:25:27.737094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbeba6-885d-4307-8042-1a1aa5eb3d0c service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:27.737372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbeba6-885d-4307-8042-1a1aa5eb3d0c service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:27.737640 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbeba6-885d-4307-8042-1a1aa5eb3d0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:27.739275 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-5efbeba6-885d-4307-8042-1a1aa5eb3d0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:27.828295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbeba6-885d-4307-8042-1a1aa5eb3d0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:25:27.829958 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbeba6-885d-4307-8042-1a1aa5eb3d0c service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:25:27.848087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 716/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:25:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:25:28.913211 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3f98a-2d61-488f-bd8e-158c47514573 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:28.913807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3f98a-2d61-488f-bd8e-158c47514573 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:28.913807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3f98a-2d61-488f-bd8e-158c47514573 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:28.915137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:25:28.921848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8452d9-c0d3-4fe1-b749-55c4da9765de None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:28.922305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8452d9-c0d3-4fe1-b749-55c4da9765de None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:28.922415 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8452d9-c0d3-4fe1-b749-55c4da9765de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:28.998376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-7b8452d9-c0d3-4fe1-b749-55c4da9765de None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:28.999687 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7b8452d9-c0d3-4fe1-b749-55c4da9765de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:29.001706 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:29.097151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:25:29.247085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3f98a-2d61-488f-bd8e-158c47514573 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:25:29.248688 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-00b3f98a-2d61-488f-bd8e-158c47514573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:29.395418 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3f98a-2d61-488f-bd8e-158c47514573 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:25:29.423024 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:29.511255 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5aecd-ea54-4e19-a064-a582b2245e31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:25:29.511777 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5aecd-ea54-4e19-a064-a582b2245e31 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:29.512053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5aecd-ea54-4e19-a064-a582b2245e31 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:29.512883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5aecd-ea54-4e19-a064-a582b2245e31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:29.514529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-60d5aecd-ea54-4e19-a064-a582b2245e31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:29.602399 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5aecd-ea54-4e19-a064-a582b2245e31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:25:29.604023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5aecd-ea54-4e19-a064-a582b2245e31 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:25:29.622657 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 723/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:25:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:25:31.681716 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806183b-861f-4eb7-a01c-a1356f30cf2d None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:31.682262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806183b-861f-4eb7-a01c-a1356f30cf2d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:31.682262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806183b-861f-4eb7-a01c-a1356f30cf2d None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:31.683605 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:25:31.689660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf433594-9f3d-4b7b-8d33-ccf0e7b081aa None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:31.690106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf433594-9f3d-4b7b-8d33-ccf0e7b081aa None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:31.690212 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf433594-9f3d-4b7b-8d33-ccf0e7b081aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:31.731494 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:31.757340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-bf433594-9f3d-4b7b-8d33-ccf0e7b081aa None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:31.758574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-bf433594-9f3d-4b7b-8d33-ccf0e7b081aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:31.856485 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:25:32.142744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806183b-861f-4eb7-a01c-a1356f30cf2d None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:25:32.144396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1806183b-861f-4eb7-a01c-a1356f30cf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:32.249499 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806183b-861f-4eb7-a01c-a1356f30cf2d None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:25:32.282596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:32.323429 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431cf3e-3e31-469a-b173-8e6f79bd39dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:25:32.324035 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431cf3e-3e31-469a-b173-8e6f79bd39dd service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:32.324312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431cf3e-3e31-469a-b173-8e6f79bd39dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:32.325093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431cf3e-3e31-469a-b173-8e6f79bd39dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:32.326683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-0431cf3e-3e31-469a-b173-8e6f79bd39dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:32.435473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431cf3e-3e31-469a-b173-8e6f79bd39dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:25:32.436908 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431cf3e-3e31-469a-b173-8e6f79bd39dd service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:25:32.455279 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 719/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:25:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:25:34.751642 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d01c3-0234-4b77-9598-57b3831cf470 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:34.752196 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d01c3-0234-4b77-9598-57b3831cf470 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:34.752196 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d01c3-0234-4b77-9598-57b3831cf470 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:34.754917 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:25:34.759134 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cf641-5d15-407a-86fa-738be26185ea None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:34.759564 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cf641-5d15-407a-86fa-738be26185ea None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:34.759675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cf641-5d15-407a-86fa-738be26185ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:34.827581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-8c6cf641-5d15-407a-86fa-738be26185ea None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:34.828778 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8c6cf641-5d15-407a-86fa-738be26185ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:34.842357 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:34.927192 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:25:35.212632 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d01c3-0234-4b77-9598-57b3831cf470 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:25:35.214218 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-244d01c3-0234-4b77-9598-57b3831cf470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:35.316090 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d01c3-0234-4b77-9598-57b3831cf470 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:25:35.328538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:35.390311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3dc2ac-3d50-4171-803b-009093f0e997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:25:35.390941 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3dc2ac-3d50-4171-803b-009093f0e997 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:35.391222 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3dc2ac-3d50-4171-803b-009093f0e997 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:35.391493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3dc2ac-3d50-4171-803b-009093f0e997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:35.393080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-db3dc2ac-3d50-4171-803b-009093f0e997 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:35.501499 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3dc2ac-3d50-4171-803b-009093f0e997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:25:35.502958 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3dc2ac-3d50-4171-803b-009093f0e997 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:25:35.521225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 726/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:25:38.002950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0eac48-fbd9-4796-838d-ac39d0516e08 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:38.003505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0eac48-fbd9-4796-838d-ac39d0516e08 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:38.003505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0eac48-fbd9-4796-838d-ac39d0516e08 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:38.004828 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:25:38.010127 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43079fae-790c-4f49-8c27-04a1245f3876 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:38.010581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43079fae-790c-4f49-8c27-04a1245f3876 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:38.010684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43079fae-790c-4f49-8c27-04a1245f3876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:38.059208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:38.077488 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-43079fae-790c-4f49-8c27-04a1245f3876 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:38.078679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-43079fae-790c-4f49-8c27-04a1245f3876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:38.174670 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:25:38.461577 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0eac48-fbd9-4796-838d-ac39d0516e08 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:25:38.463135 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-5b0eac48-fbd9-4796-838d-ac39d0516e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:38.565535 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0eac48-fbd9-4796-838d-ac39d0516e08 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:25:38.606120 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:38.640770 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c4c8f-bbbc-4189-b87b-a94455835331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:25:38.641371 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c4c8f-bbbc-4189-b87b-a94455835331 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:38.641648 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c4c8f-bbbc-4189-b87b-a94455835331 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:38.641916 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c4c8f-bbbc-4189-b87b-a94455835331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:38.643604 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-db4c4c8f-bbbc-4189-b87b-a94455835331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:38.750876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c4c8f-bbbc-4189-b87b-a94455835331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:25:38.752303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c4c8f-bbbc-4189-b87b-a94455835331 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:25:38.770769 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 722/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:25:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:25:41.226067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eef66-6072-4d67-90c7-c9d8a500d386 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:41.226614 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eef66-6072-4d67-90c7-c9d8a500d386 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:41.226707 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eef66-6072-4d67-90c7-c9d8a500d386 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:41.228046 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:25:41.234585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a70716-408f-4b8a-bb74-d517472f754c None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:41.235030 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a70716-408f-4b8a-bb74-d517472f754c None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:41.235175 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a70716-408f-4b8a-bb74-d517472f754c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:41.301160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-b8a70716-408f-4b8a-bb74-d517472f754c None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:41.302373 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b8a70716-408f-4b8a-bb74-d517472f754c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:41.323257 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:41.400629 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:25:41.690569 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0eef66-6072-4d67-90c7-c9d8a500d386 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:25:41.692150 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-0a0eef66-6072-4d67-90c7-c9d8a500d386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:41.796353 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0eef66-6072-4d67-90c7-c9d8a500d386 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:25:41.816595 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:41.870164 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc10e75-39d7-4768-8fd5-7748eb8bd5ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:25:41.870702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10e75-39d7-4768-8fd5-7748eb8bd5ce service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:41.871004 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10e75-39d7-4768-8fd5-7748eb8bd5ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:41.871310 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10e75-39d7-4768-8fd5-7748eb8bd5ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:41.872892 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-efc10e75-39d7-4768-8fd5-7748eb8bd5ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:41.980341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc10e75-39d7-4768-8fd5-7748eb8bd5ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:25:41.982412 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc10e75-39d7-4768-8fd5-7748eb8bd5ce service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:25:42.000958 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 729/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:25:44.331775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b3e28-5c76-46ae-953f-1efd97e14170 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:44.332342 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b3e28-5c76-46ae-953f-1efd97e14170 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:44.332436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b3e28-5c76-46ae-953f-1efd97e14170 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:44.333758 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:25:44.339169 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dd9fa-68f2-41b7-bc58-4d1f19f4bf36 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:44.339589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dd9fa-68f2-41b7-bc58-4d1f19f4bf36 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:44.339710 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dd9fa-68f2-41b7-bc58-4d1f19f4bf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:44.403114 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:44.406432 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-0b3dd9fa-68f2-41b7-bc58-4d1f19f4bf36 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:44.408090 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-0b3dd9fa-68f2-41b7-bc58-4d1f19f4bf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:44.503573 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:25:44.787691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b3e28-5c76-46ae-953f-1efd97e14170 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:25:44.789236 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-104b3e28-5c76-46ae-953f-1efd97e14170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:44.892211 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b3e28-5c76-46ae-953f-1efd97e14170 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:25:44.943788 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:44.968274 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04892c-08e5-4adb-bfe6-02fc0269a7ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:25:44.968940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04892c-08e5-4adb-bfe6-02fc0269a7ee service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:44.969217 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04892c-08e5-4adb-bfe6-02fc0269a7ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:44.969487 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04892c-08e5-4adb-bfe6-02fc0269a7ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:44.971123 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-bf04892c-08e5-4adb-bfe6-02fc0269a7ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:45.081164 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04892c-08e5-4adb-bfe6-02fc0269a7ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:25:45.082513 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04892c-08e5-4adb-bfe6-02fc0269a7ee service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:25:45.101763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 725/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:25:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:25:47.427558 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786c7b1-e3d8-4ec4-9fbd-aa1164ab6856 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:47.428015 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786c7b1-e3d8-4ec4-9fbd-aa1164ab6856 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:47.428113 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786c7b1-e3d8-4ec4-9fbd-aa1164ab6856 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:47.429691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:25:47.435212 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd02de-8868-4552-b98a-237105275084 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:47.435635 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd02de-8868-4552-b98a-237105275084 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:47.435758 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd02de-8868-4552-b98a-237105275084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:47.503267 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-aadd02de-8868-4552-b98a-237105275084 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:47.504476 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-aadd02de-8868-4552-b98a-237105275084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:47.533694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:47.601654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:25:47.884907 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786c7b1-e3d8-4ec4-9fbd-aa1164ab6856 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:25:47.886446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f786c7b1-e3d8-4ec4-9fbd-aa1164ab6856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:47.990559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786c7b1-e3d8-4ec4-9fbd-aa1164ab6856 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:25:48.019075 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:48.064939 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee375671-2496-4c23-af62-8910d4912c21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:25:48.065541 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee375671-2496-4c23-af62-8910d4912c21 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:48.065819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee375671-2496-4c23-af62-8910d4912c21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:48.066091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee375671-2496-4c23-af62-8910d4912c21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:48.067718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-ee375671-2496-4c23-af62-8910d4912c21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:48.176282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee375671-2496-4c23-af62-8910d4912c21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:25:48.177612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee375671-2496-4c23-af62-8910d4912c21 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:25:48.195653 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 732/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:25:50.393365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfba37-7312-4aa0-9b89-5763f2c541a1 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:50.393935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfba37-7312-4aa0-9b89-5763f2c541a1 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:50.393935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfba37-7312-4aa0-9b89-5763f2c541a1 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:50.395302 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:25:50.400818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31d479-9265-43ad-bb97-7255e02cadb5 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:50.401484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31d479-9265-43ad-bb97-7255e02cadb5 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:50.401614 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31d479-9265-43ad-bb97-7255e02cadb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:50.468068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-9f31d479-9265-43ad-bb97-7255e02cadb5 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:50.469274 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-9f31d479-9265-43ad-bb97-7255e02cadb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:50.477453 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:50.565471 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:25:50.853885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfba37-7312-4aa0-9b89-5763f2c541a1 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:25:50.855522 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-f7dfba37-7312-4aa0-9b89-5763f2c541a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:50.959146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfba37-7312-4aa0-9b89-5763f2c541a1 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:25:51.015484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:51.034642 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bcf27-68a8-4418-b23d-abb050bf6010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:25:51.035284 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bcf27-68a8-4418-b23d-abb050bf6010 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:51.035566 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bcf27-68a8-4418-b23d-abb050bf6010 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:51.035841 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bcf27-68a8-4418-b23d-abb050bf6010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:51.037445 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-012bcf27-68a8-4418-b23d-abb050bf6010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:51.146609 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bcf27-68a8-4418-b23d-abb050bf6010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:25:51.147986 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bcf27-68a8-4418-b23d-abb050bf6010 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:25:51.166290 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 728/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:25:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:25:53.387698 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13654c79-2d54-4c29-96d7-5c75e0a740a4 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:53.388305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13654c79-2d54-4c29-96d7-5c75e0a740a4 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:53.388416 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13654c79-2d54-4c29-96d7-5c75e0a740a4 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:53.389682 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:25:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:25:53.395261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ffe6c-7d9f-438d-9007-7beb0fb8d849 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:53.395695 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ffe6c-7d9f-438d-9007-7beb0fb8d849 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:53.395801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ffe6c-7d9f-438d-9007-7beb0fb8d849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:53.462699 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-ce5ffe6c-7d9f-438d-9007-7beb0fb8d849 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:53.463926 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ce5ffe6c-7d9f-438d-9007-7beb0fb8d849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:53.502535 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:53.560688 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:25:53.849422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13654c79-2d54-4c29-96d7-5c75e0a740a4 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:25:53.851017 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-13654c79-2d54-4c29-96d7-5c75e0a740a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:53.955878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13654c79-2d54-4c29-96d7-5c75e0a740a4 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:25:53.996717 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:54.032342 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df5228-9b00-44ca-8893-2cd0e59753c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:25:54.032969 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df5228-9b00-44ca-8893-2cd0e59753c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:54.033246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df5228-9b00-44ca-8893-2cd0e59753c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:54.033516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df5228-9b00-44ca-8893-2cd0e59753c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:54.035137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-90df5228-9b00-44ca-8893-2cd0e59753c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:54.143105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df5228-9b00-44ca-8893-2cd0e59753c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:25:54.144451 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df5228-9b00-44ca-8893-2cd0e59753c0 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:25:54.162870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 735/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:25:56.333413 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532e5b2-e99d-4e1e-bdd7-a58c6bffeda6 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:56.333994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532e5b2-e99d-4e1e-bdd7-a58c6bffeda6 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:56.333994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532e5b2-e99d-4e1e-bdd7-a58c6bffeda6 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:56.335343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:25:56.340702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bac23-d832-4c8c-b1b1-7e3609af8330 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:56.341156 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bac23-d832-4c8c-b1b1-7e3609af8330 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:56.341271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bac23-d832-4c8c-b1b1-7e3609af8330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:56.407905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-195bac23-d832-4c8c-b1b1-7e3609af8330 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:56.409128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-195bac23-d832-4c8c-b1b1-7e3609af8330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:56.428384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:56.506899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:25:56.790014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532e5b2-e99d-4e1e-bdd7-a58c6bffeda6 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:25:56.791589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d532e5b2-e99d-4e1e-bdd7-a58c6bffeda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:56.894305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532e5b2-e99d-4e1e-bdd7-a58c6bffeda6 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:25:56.961437 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:56.969038 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05067a0c-1a21-409f-9f91-79a2a56d5ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:25:56.969644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05067a0c-1a21-409f-9f91-79a2a56d5ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:56.969923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05067a0c-1a21-409f-9f91-79a2a56d5ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:56.970196 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05067a0c-1a21-409f-9f91-79a2a56d5ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:56.971837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-05067a0c-1a21-409f-9f91-79a2a56d5ed3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:57.081821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05067a0c-1a21-409f-9f91-79a2a56d5ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:25:57.083235 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05067a0c-1a21-409f-9f91-79a2a56d5ed3 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:25:57.101666 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 731/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:25:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:25:59.271372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c8b5d-bfe5-42c0-a5f0-64b0613b47da None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:59.271930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c8b5d-bfe5-42c0-a5f0-64b0613b47da None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:59.271930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c8b5d-bfe5-42c0-a5f0-64b0613b47da None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:59.273239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:25:59.279765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad5c2c-40ab-4a6a-8777-859ab181f64c None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:59.280198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad5c2c-40ab-4a6a-8777-859ab181f64c None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:59.280312 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad5c2c-40ab-4a6a-8777-859ab181f64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:59.346258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-39ad5c2c-40ab-4a6a-8777-859ab181f64c None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:59.347519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-39ad5c2c-40ab-4a6a-8777-859ab181f64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:59.394848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:59.446463 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:25:59.731572 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c8b5d-bfe5-42c0-a5f0-64b0613b47da None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:25:59.733193 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d65c8b5d-bfe5-42c0-a5f0-64b0613b47da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:59.835651 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c8b5d-bfe5-42c0-a5f0-64b0613b47da None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:25:59.884623 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:59.910157 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f48db-f994-4cd7-8e97-1a87dd4bd9c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:25:59.910749 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f48db-f994-4cd7-8e97-1a87dd4bd9c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:59.911046 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f48db-f994-4cd7-8e97-1a87dd4bd9c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:59.911313 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f48db-f994-4cd7-8e97-1a87dd4bd9c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:59.912882 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-597f48db-f994-4cd7-8e97-1a87dd4bd9c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:00.019839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f48db-f994-4cd7-8e97-1a87dd4bd9c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:26:00.021257 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f48db-f994-4cd7-8e97-1a87dd4bd9c3 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:26:00.039709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 738/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:25:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:26:09.444952 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=22 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:26:10.037264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=66 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:26:20.097094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00012f-ad8e-4b10-9372-f3b8ec98c19a None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:20.098184 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00012f-ad8e-4b10-9372-f3b8ec98c19a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:20.098184 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00012f-ad8e-4b10-9372-f3b8ec98c19a None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:20.100103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 733/1471] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:20.105755 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e203a1-66c8-4e4e-9c51-3ed12a6232cf None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:20.106167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e203a1-66c8-4e4e-9c51-3ed12a6232cf None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:20.106309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e203a1-66c8-4e4e-9c51-3ed12a6232cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:20.172239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-99e203a1-66c8-4e4e-9c51-3ed12a6232cf None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:20.173449 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-99e203a1-66c8-4e4e-9c51-3ed12a6232cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:20.270411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 739/1472] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:26:20.568134 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716e9b1-d965-4003-ab1c-0f85054a5b1b None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:20.568420 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716e9b1-d965-4003-ab1c-0f85054a5b1b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:20.568720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716e9b1-d965-4003-ab1c-0f85054a5b1b None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:20.570088 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 734/1473] 10.222.0.25 () {54 vars in 962 bytes} [Sat Sep 24 19:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:20.575677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bb004-8314-4191-b73d-58e938cf7117 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:20.575961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bb004-8314-4191-b73d-58e938cf7117 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:20.576235 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bb004-8314-4191-b73d-58e938cf7117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:20.651843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-248bb004-8314-4191-b73d-58e938cf7117 None None] MFA Rules not processed for user `54232cb318b04e9286f58dae8b2a3fd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:20.653220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-248bb004-8314-4191-b73d-58e938cf7117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:20.674341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:26:20.729683 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 740/1474] 10.222.0.25 () {58 vars in 1059 bytes} [Sat Sep 24 19:26:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:26:20.737329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716e9b1-d965-4003-ab1c-0f85054a5b1b None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:26:20.738863 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d716e9b1-d965-4003-ab1c-0f85054a5b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:20.846264 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716e9b1-d965-4003-ab1c-0f85054a5b1b None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:26:20.922779 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e710690-3a00-4d5f-af98-08036e104bf2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54232cb318b04e9286f58dae8b2a3fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:26:20.923424 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e710690-3a00-4d5f-af98-08036e104bf2 service glance] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:20.923704 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e710690-3a00-4d5f-af98-08036e104bf2 service glance] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:20.923974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e710690-3a00-4d5f-af98-08036e104bf2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:20.925628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-3e710690-3a00-4d5f-af98-08036e104bf2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:20.979062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:26:21.035181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e710690-3a00-4d5f-af98-08036e104bf2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:26:21.036605 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e710690-3a00-4d5f-af98-08036e104bf2 service glance] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:26:21.055121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 735/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:26:23.296826 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b81f5b-7a31-4b1f-8142-5aaaaa65e9cf None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:23.297420 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b81f5b-7a31-4b1f-8142-5aaaaa65e9cf None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:23.297420 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b81f5b-7a31-4b1f-8142-5aaaaa65e9cf None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:23.298717 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 741/1476] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:23.304226 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fcee7-5244-4181-a841-399360990024 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:23.304633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fcee7-5244-4181-a841-399360990024 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:23.304772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fcee7-5244-4181-a841-399360990024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:23.370077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-402fcee7-5244-4181-a841-399360990024 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:23.371512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-402fcee7-5244-4181-a841-399360990024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:23.473867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 736/1477] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:26:23.750812 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b81f5b-7a31-4b1f-8142-5aaaaa65e9cf None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:26:23.752428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-04b81f5b-7a31-4b1f-8142-5aaaaa65e9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:23.880804 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b81f5b-7a31-4b1f-8142-5aaaaa65e9cf None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:26:23.930016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:26:23.976543 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f491a87-2392-4f03-b178-02f32ed89b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:26:23.977156 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f491a87-2392-4f03-b178-02f32ed89b5d admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:23.977428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f491a87-2392-4f03-b178-02f32ed89b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:23.977697 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f491a87-2392-4f03-b178-02f32ed89b5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:23.978330 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f491a87-2392-4f03-b178-02f32ed89b5d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:26:23.980781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: WARNING py.warnings [None req-4f491a87-2392-4f03-b178-02f32ed89b5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:26:23.980781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: warnings.warn(msg) Sep 24 19:26:23.980781 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: Sep 24 19:26:23.981917 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f491a87-2392-4f03-b178-02f32ed89b5d admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:26:24.001865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 742/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Sat Sep 24 19:26:23 2022] GET /identity/v3/projects => generated 2553 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:26:26.185390 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da70270-aa72-45ee-a4d2-9c0910348af9 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:26.185935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da70270-aa72-45ee-a4d2-9c0910348af9 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:26.185935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da70270-aa72-45ee-a4d2-9c0910348af9 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:26.187378 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 737/1479] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:26:26.192549 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99140de-7138-4460-b90d-dd35a592c113 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:26.192949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99140de-7138-4460-b90d-dd35a592c113 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:26.193092 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99140de-7138-4460-b90d-dd35a592c113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:26.259376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-f99140de-7138-4460-b90d-dd35a592c113 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:26.260588 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f99140de-7138-4460-b90d-dd35a592c113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:26.355987 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 743/1480] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:26:26.651990 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da70270-aa72-45ee-a4d2-9c0910348af9 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:26:26.653726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-6da70270-aa72-45ee-a4d2-9c0910348af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:26.663507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:26:26.798725 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da70270-aa72-45ee-a4d2-9c0910348af9 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:26:26.878194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:26:26.910977 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe22d2-32ca-41b3-8e80-5817cd1785c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:26:26.911517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe22d2-32ca-41b3-8e80-5817cd1785c7 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:26.911796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe22d2-32ca-41b3-8e80-5817cd1785c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:26.912066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe22d2-32ca-41b3-8e80-5817cd1785c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:26.913660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2ffe22d2-32ca-41b3-8e80-5817cd1785c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:27.004095 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe22d2-32ca-41b3-8e80-5817cd1785c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:26:27.005688 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe22d2-32ca-41b3-8e80-5817cd1785c7 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:26:27.023718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 738/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:26:29.354295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c19f3a-ff5d-4ee4-834f-9b1c76b39c9f None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:29.355517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c19f3a-ff5d-4ee4-834f-9b1c76b39c9f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:29.355517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c19f3a-ff5d-4ee4-834f-9b1c76b39c9f None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:29.356855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 744/1482] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:26:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:29.362132 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ad6ea-961b-46ad-aa23-bf3342c8ff1d None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:29.362558 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ad6ea-961b-46ad-aa23-bf3342c8ff1d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:29.362660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ad6ea-961b-46ad-aa23-bf3342c8ff1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:29.438094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-cf2ad6ea-961b-46ad-aa23-bf3342c8ff1d None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:29.439366 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-cf2ad6ea-961b-46ad-aa23-bf3342c8ff1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:29.491557 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:26:29.542085 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 739/1483] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:26:29.834580 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c19f3a-ff5d-4ee4-834f-9b1c76b39c9f None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:26:29.836153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-38c19f3a-ff5d-4ee4-834f-9b1c76b39c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:29.860841 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:26:29.940661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c19f3a-ff5d-4ee4-834f-9b1c76b39c9f None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:26:30.013962 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cf644-b90b-4d17-90ac-85edaf0a4189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:26:30.014555 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cf644-b90b-4d17-90ac-85edaf0a4189 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:30.014838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cf644-b90b-4d17-90ac-85edaf0a4189 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:30.015116 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cf644-b90b-4d17-90ac-85edaf0a4189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:30.016691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-739cf644-b90b-4d17-90ac-85edaf0a4189 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:30.090366 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:26:30.125005 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739cf644-b90b-4d17-90ac-85edaf0a4189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:26:30.126430 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739cf644-b90b-4d17-90ac-85edaf0a4189 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:26:30.145168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 745/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:26:32.342563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa56d3-c990-4860-b011-bbe7b01ba2a1 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:32.343176 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa56d3-c990-4860-b011-bbe7b01ba2a1 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:32.343176 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa56d3-c990-4860-b011-bbe7b01ba2a1 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:32.344495 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 740/1485] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:32.349839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44987fcd-667d-4a73-a8a5-9e4e3cf394c5 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:32.350255 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44987fcd-667d-4a73-a8a5-9e4e3cf394c5 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:32.350387 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44987fcd-667d-4a73-a8a5-9e4e3cf394c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:32.418282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-44987fcd-667d-4a73-a8a5-9e4e3cf394c5 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:32.419558 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-44987fcd-667d-4a73-a8a5-9e4e3cf394c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:32.515318 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 746/1486] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:26:32.802980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa56d3-c990-4860-b011-bbe7b01ba2a1 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:26:32.804536 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-04aa56d3-c990-4860-b011-bbe7b01ba2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:32.908089 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa56d3-c990-4860-b011-bbe7b01ba2a1 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:26:32.983865 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:26:32.985542 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c8f76-4d68-4277-9221-b1eb696366d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:26:32.986188 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c8f76-4d68-4277-9221-b1eb696366d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:32.986685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c8f76-4d68-4277-9221-b1eb696366d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:32.987163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c8f76-4d68-4277-9221-b1eb696366d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:32.988911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-877c8f76-4d68-4277-9221-b1eb696366d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:33.099653 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c8f76-4d68-4277-9221-b1eb696366d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:26:33.100907 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c8f76-4d68-4277-9221-b1eb696366d9 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:26:33.119903 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 741/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:26:35.375895 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fdcef-b0db-4bce-a6c9-91054895e9a6 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:35.376485 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fdcef-b0db-4bce-a6c9-91054895e9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:35.376485 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fdcef-b0db-4bce-a6c9-91054895e9a6 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:35.377765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 747/1488] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:35.383097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f60c4d-43af-402b-a830-0ea4776383cd None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:35.383544 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f60c4d-43af-402b-a830-0ea4776383cd None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:35.383684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f60c4d-43af-402b-a830-0ea4776383cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:35.450105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-a7f60c4d-43af-402b-a830-0ea4776383cd None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:35.451339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a7f60c4d-43af-402b-a830-0ea4776383cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:35.503837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:26:35.549623 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 742/1489] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:26:35.850157 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fdcef-b0db-4bce-a6c9-91054895e9a6 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:26:35.851739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-079fdcef-b0db-4bce-a6c9-91054895e9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:35.888234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:26:35.956888 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fdcef-b0db-4bce-a6c9-91054895e9a6 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:26:36.035221 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a8e2a-5837-4858-b266-68a15aed4623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:26:36.035817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a8e2a-5837-4858-b266-68a15aed4623 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:36.036094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a8e2a-5837-4858-b266-68a15aed4623 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:36.036365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a8e2a-5837-4858-b266-68a15aed4623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:36.037966 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-138a8e2a-5837-4858-b266-68a15aed4623 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:36.117910 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:26:36.147309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a8e2a-5837-4858-b266-68a15aed4623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:26:36.148721 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a8e2a-5837-4858-b266-68a15aed4623 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:26:36.168117 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 748/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:26:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:26:38.518250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf423b4-fa23-4ff6-a993-68365e5ebed3 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:38.518782 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf423b4-fa23-4ff6-a993-68365e5ebed3 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:38.518782 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf423b4-fa23-4ff6-a993-68365e5ebed3 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:38.520196 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 743/1491] 10.222.0.25 () {54 vars in 927 bytes} [Sat Sep 24 19:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:38.525517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce2aac-9f18-408d-a79f-c18f96b26e9b None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:38.525951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce2aac-9f18-408d-a79f-c18f96b26e9b None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:38.526058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce2aac-9f18-408d-a79f-c18f96b26e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:38.592883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-16ce2aac-9f18-408d-a79f-c18f96b26e9b None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:38.594076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-16ce2aac-9f18-408d-a79f-c18f96b26e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:38.690944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 749/1492] 10.222.0.25 () {58 vars in 1024 bytes} [Sat Sep 24 19:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:26:38.978685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf423b4-fa23-4ff6-a993-68365e5ebed3 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:26:38.980923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ddf423b4-fa23-4ff6-a993-68365e5ebed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:39.095371 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf423b4-fa23-4ff6-a993-68365e5ebed3 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:26:39.173257 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640055f9-619d-4723-8d74-aa3e09ddcc6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:26:39.173862 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640055f9-619d-4723-8d74-aa3e09ddcc6e service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:39.174139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640055f9-619d-4723-8d74-aa3e09ddcc6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:39.174406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640055f9-619d-4723-8d74-aa3e09ddcc6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:39.176036 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-640055f9-619d-4723-8d74-aa3e09ddcc6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:39.184631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:26:39.285570 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640055f9-619d-4723-8d74-aa3e09ddcc6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:26:39.287033 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640055f9-619d-4723-8d74-aa3e09ddcc6e service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:26:39.421337 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 744/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:26:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:26:48.687762 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=82 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:26:49.418798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=50 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:27:59.174849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e7f6f-ee03-47c5-a678-80a8b7544751 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:59.175444 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e7f6f-ee03-47c5-a678-80a8b7544751 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:59.175444 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e7f6f-ee03-47c5-a678-80a8b7544751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:59.252494 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-be5e7f6f-ee03-47c5-a678-80a8b7544751 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:59.253687 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-be5e7f6f-ee03-47c5-a678-80a8b7544751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:59.348685 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 750/1494] 10.222.0.25 () {58 vars in 958 bytes} [Sat Sep 24 19:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:59.357326 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf46c0c-c04e-4328-b78c-cb513255d6e8 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:59.357823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf46c0c-c04e-4328-b78c-cb513255d6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:59.357931 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf46c0c-c04e-4328-b78c-cb513255d6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:59.433580 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-4bf46c0c-c04e-4328-b78c-cb513255d6e8 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:59.434700 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4bf46c0c-c04e-4328-b78c-cb513255d6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:59.538795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 745/1495] 10.222.0.25 () {58 vars in 958 bytes} [Sat Sep 24 19:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:59.545294 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e7f6f-ee03-47c5-a678-80a8b7544751 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:59.546502 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-be5e7f6f-ee03-47c5-a678-80a8b7544751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:59.558002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e7f6f-ee03-47c5-a678-80a8b7544751 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:59.618780 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:27:59.653299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb58014-083b-4184-b60f-c3444e03ec91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:59.653686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb58014-083b-4184-b60f-c3444e03ec91 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:59.654179 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb58014-083b-4184-b60f-c3444e03ec91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:59.654179 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb58014-083b-4184-b60f-c3444e03ec91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:59.654803 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb58014-083b-4184-b60f-c3444e03ec91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:27:59.655201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb58014-083b-4184-b60f-c3444e03ec91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:59.656181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: WARNING py.warnings [None req-6fb58014-083b-4184-b60f-c3444e03ec91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:27:59.656181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: warnings.warn(msg) Sep 24 19:27:59.656181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: Sep 24 19:27:59.656992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb58014-083b-4184-b60f-c3444e03ec91 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:27:59.669391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 751/1496] 10.222.0.25 () {58 vars in 1153 bytes} [Sat Sep 24 19:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:27:59.677670 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf46c0c-c04e-4328-b78c-cb513255d6e8 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:59.686970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf46c0c-c04e-4328-b78c-cb513255d6e8 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:59.747474 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:27:59.782271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51b1dd-12e1-4978-962d-a6e411ef1bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:59.782932 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51b1dd-12e1-4978-962d-a6e411ef1bdd admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:59.783207 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51b1dd-12e1-4978-962d-a6e411ef1bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:59.783477 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51b1dd-12e1-4978-962d-a6e411ef1bdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:59.784121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51b1dd-12e1-4978-962d-a6e411ef1bdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:59.785838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: WARNING py.warnings [None req-0a51b1dd-12e1-4978-962d-a6e411ef1bdd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:27:59.785838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: warnings.warn(msg) Sep 24 19:27:59.785838 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: Sep 24 19:27:59.787040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51b1dd-12e1-4978-962d-a6e411ef1bdd admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:27:59.843513 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 746/1497] 10.222.0.25 () {60 vars in 1153 bytes} [Sat Sep 24 19:27:59 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:27:59.847659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb58014-083b-4184-b60f-c3444e03ec91 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:59.849171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6fb58014-083b-4184-b60f-c3444e03ec91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:59.881902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb58014-083b-4184-b60f-c3444e03ec91 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:59.975990 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970869cb-c14f-4d60-b02d-1a4de075b5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:59.976491 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970869cb-c14f-4d60-b02d-1a4de075b5b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:59.976765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970869cb-c14f-4d60-b02d-1a4de075b5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:59.977032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970869cb-c14f-4d60-b02d-1a4de075b5b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:59.977678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970869cb-c14f-4d60-b02d-1a4de075b5b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:59.978672 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: WARNING py.warnings [None req-970869cb-c14f-4d60-b02d-1a4de075b5b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:27:59.978672 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: warnings.warn(msg) Sep 24 19:27:59.978672 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: Sep 24 19:27:59.979890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970869cb-c14f-4d60-b02d-1a4de075b5b3 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:28:00.021495 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 752/1498] 10.222.0.25 () {60 vars in 1144 bytes} [Sat Sep 24 19:27:59 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:28:00.026492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51b1dd-12e1-4978-962d-a6e411ef1bdd admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:28:00.028289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-0a51b1dd-12e1-4978-962d-a6e411ef1bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:00.089848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51b1dd-12e1-4978-962d-a6e411ef1bdd admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:28:00.176703 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:28:00.187978 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021c5c2-3494-44d1-bd29-51bb1d3c6bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:28:00.188591 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021c5c2-3494-44d1-bd29-51bb1d3c6bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:00.188867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021c5c2-3494-44d1-bd29-51bb1d3c6bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:00.189137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021c5c2-3494-44d1-bd29-51bb1d3c6bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:00.189770 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021c5c2-3494-44d1-bd29-51bb1d3c6bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:28:00.190761 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: WARNING py.warnings [None req-a021c5c2-3494-44d1-bd29-51bb1d3c6bb8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:28:00.190761 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: warnings.warn(msg) Sep 24 19:28:00.190761 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: Sep 24 19:28:00.191672 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021c5c2-3494-44d1-bd29-51bb1d3c6bb8 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:28:00.204618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 747/1499] 10.222.0.25 () {58 vars in 1122 bytes} [Sat Sep 24 19:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:28:00.208697 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970869cb-c14f-4d60-b02d-1a4de075b5b3 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:28:00.210247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-970869cb-c14f-4d60-b02d-1a4de075b5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:00.222288 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970869cb-c14f-4d60-b02d-1a4de075b5b3 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:28:00.247813 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:28:00.318183 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57c25b-4de7-408a-81e7-8919b5a698b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:28:00.318783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57c25b-4de7-408a-81e7-8919b5a698b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:00.319092 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57c25b-4de7-408a-81e7-8919b5a698b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:00.319368 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57c25b-4de7-408a-81e7-8919b5a698b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:00.319996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57c25b-4de7-408a-81e7-8919b5a698b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:28:00.321002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: WARNING py.warnings [None req-1a57c25b-4de7-408a-81e7-8919b5a698b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:28:00.321002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: warnings.warn(msg) Sep 24 19:28:00.321002 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: Sep 24 19:28:00.321970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57c25b-4de7-408a-81e7-8919b5a698b9 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:28:00.333999 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 753/1500] 10.222.0.25 () {58 vars in 1122 bytes} [Sat Sep 24 19:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:28:00.338881 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021c5c2-3494-44d1-bd29-51bb1d3c6bb8 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:28:00.340391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a021c5c2-3494-44d1-bd29-51bb1d3c6bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:00.374452 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021c5c2-3494-44d1-bd29-51bb1d3c6bb8 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:28:00.469677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd02c3d-123c-46b7-b670-e770602b4d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:28:00.470330 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd02c3d-123c-46b7-b670-e770602b4d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:00.470608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd02c3d-123c-46b7-b670-e770602b4d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:00.470907 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd02c3d-123c-46b7-b670-e770602b4d1d admin admin] PATH_INFO: `/v3/projects/e6495b4b0e324c2e893b22e2195dd7a0/users/5be63fe476f24e08be418641fdd325a5/roles/ef0525432e044dd18b3ae4b32d29030e` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:00.493617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd02c3d-123c-46b7-b670-e770602b4d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6495b4b0e324c2e893b22e2195dd7a0, user_id=5be63fe476f24e08be418641fdd325a5, role_id=ef0525432e044dd18b3ae4b32d29030e)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:28:00.494628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: WARNING py.warnings [None req-cfd02c3d-123c-46b7-b670-e770602b4d1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:28:00.494628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: warnings.warn(msg) Sep 24 19:28:00.494628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: Sep 24 19:28:00.496581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd02c3d-123c-46b7-b670-e770602b4d1d admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:28:00.521694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 748/1501] 10.222.0.25 () {60 vars in 1483 bytes} [Sat Sep 24 19:28:00 2022] PUT /identity/v3/projects/e6495b4b0e324c2e893b22e2195dd7a0/users/5be63fe476f24e08be418641fdd325a5/roles/ef0525432e044dd18b3ae4b32d29030e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:28:00.534488 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29363707-fd48-4b79-80b0-59911838a481 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:00.534765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29363707-fd48-4b79-80b0-59911838a481 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:00.535083 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29363707-fd48-4b79-80b0-59911838a481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:00.593475 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-29363707-fd48-4b79-80b0-59911838a481 None None] MFA Rules not processed for user `5be63fe476f24e08be418641fdd325a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:28:00.594667 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-29363707-fd48-4b79-80b0-59911838a481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:00.672498 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 754/1502] 10.222.0.25 () {58 vars in 958 bytes} [Sat Sep 24 19:28:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:28:00.686160 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168edb44-6b2d-4a01-8799-65cda287f670 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:00.686450 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168edb44-6b2d-4a01-8799-65cda287f670 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:00.686726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168edb44-6b2d-4a01-8799-65cda287f670 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:00.688102 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 749/1503] 10.222.0.25 () {54 vars in 963 bytes} [Sat Sep 24 19:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:28:00.692780 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e247a1b-0a18-4cc4-b0fc-2ae405e68030 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:00.693067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e247a1b-0a18-4cc4-b0fc-2ae405e68030 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:00.693340 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e247a1b-0a18-4cc4-b0fc-2ae405e68030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:00.726238 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:28:00.770544 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-7e247a1b-0a18-4cc4-b0fc-2ae405e68030 None None] MFA Rules not processed for user `5840a13ddf8c45f2bf97a4f6d4a48d96`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:28:00.771855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7e247a1b-0a18-4cc4-b0fc-2ae405e68030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:00.847770 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 755/1504] 10.222.0.25 () {58 vars in 1060 bytes} [Sat Sep 24 19:28:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:28:00.855666 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168edb44-6b2d-4a01-8799-65cda287f670 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:28:00.857159 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-168edb44-6b2d-4a01-8799-65cda287f670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:00.907720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:28:00.963142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168edb44-6b2d-4a01-8799-65cda287f670 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:28:01.036238 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55291d-5e1a-476c-bfba-cf7cdd9a26be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5840a13ddf8c45f2bf97a4f6d4a48d96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:28:01.036765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55291d-5e1a-476c-bfba-cf7cdd9a26be service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:01.037039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55291d-5e1a-476c-bfba-cf7cdd9a26be service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:01.037307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55291d-5e1a-476c-bfba-cf7cdd9a26be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:01.038934 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-3f55291d-5e1a-476c-bfba-cf7cdd9a26be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:01.138623 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55291d-5e1a-476c-bfba-cf7cdd9a26be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:28:01.140119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55291d-5e1a-476c-bfba-cf7cdd9a26be service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:28:01.143575 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:28:01.158311 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 750/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:28:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:28:01.204159 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc746bbf-2ffb-436d-be93-7f2263bf46c8 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:01.204452 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc746bbf-2ffb-436d-be93-7f2263bf46c8 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:01.204730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc746bbf-2ffb-436d-be93-7f2263bf46c8 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:01.205974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 756/1506] 10.222.0.25 () {52 vars in 830 bytes} [Sat Sep 24 19:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:28:01.209558 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55291d-5e1a-476c-bfba-cf7cdd9a26be service cinder] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:28:01.210820 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-3f55291d-5e1a-476c-bfba-cf7cdd9a26be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:01.308970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55291d-5e1a-476c-bfba-cf7cdd9a26be service cinder] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:28:01.400262 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc72a9e-6cce-4f0a-b43f-8080c4fabddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:28:01.400926 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc72a9e-6cce-4f0a-b43f-8080c4fabddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:01.401146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc72a9e-6cce-4f0a-b43f-8080c4fabddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:01.401414 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc72a9e-6cce-4f0a-b43f-8080c4fabddf admin admin] PATH_INFO: `/v3/users/5be63fe476f24e08be418641fdd325a5` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:01.416269 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc72a9e-6cce-4f0a-b43f-8080c4fabddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5be63fe476f24e08be418641fdd325a5)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:28:01.417372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: WARNING py.warnings [None req-abc72a9e-6cce-4f0a-b43f-8080c4fabddf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:28:01.417372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: warnings.warn(msg) Sep 24 19:28:01.417372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: Sep 24 19:28:01.418585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc72a9e-6cce-4f0a-b43f-8080c4fabddf admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:28:01.429009 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:28:01.487576 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-abc72a9e-6cce-4f0a-b43f-8080c4fabddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5be63fe476f24e08be418641fdd325a5'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:28:01.488017 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-abc72a9e-6cce-4f0a-b43f-8080c4fabddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5be63fe476f24e08be418641fdd325a5'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:28:01.502991 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-abc72a9e-6cce-4f0a-b43f-8080c4fabddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5be63fe476f24e08be418641fdd325a5'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:28:01.503582 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-abc72a9e-6cce-4f0a-b43f-8080c4fabddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5be63fe476f24e08be418641fdd325a5'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:28:01.528659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-abc72a9e-6cce-4f0a-b43f-8080c4fabddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5be63fe476f24e08be418641fdd325a5'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:28:01.543684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 751/1507] 10.222.0.25 () {58 vars in 1224 bytes} [Sat Sep 24 19:28:01 2022] DELETE /identity/v3/users/5be63fe476f24e08be418641fdd325a5 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:28:01.548168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a9985-55c6-4ced-913a-6199bb694fd2 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:01.548661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a9985-55c6-4ced-913a-6199bb694fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:01.548786 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a9985-55c6-4ced-913a-6199bb694fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:01.605776 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-370a9985-55c6-4ced-913a-6199bb694fd2 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:28:01.606940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-370a9985-55c6-4ced-913a-6199bb694fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:01.681932 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:28:01.695583 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 757/1508] 10.222.0.25 () {58 vars in 958 bytes} [Sat Sep 24 19:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:28:01.704760 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc72a9e-6cce-4f0a-b43f-8080c4fabddf admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:28:01.705980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-abc72a9e-6cce-4f0a-b43f-8080c4fabddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:01.806436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc72a9e-6cce-4f0a-b43f-8080c4fabddf admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:28:01.860154 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:28:01.881074 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482ca67-1905-4598-9925-e21c27ef6018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:28:01.881690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482ca67-1905-4598-9925-e21c27ef6018 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:01.881974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482ca67-1905-4598-9925-e21c27ef6018 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:01.882247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482ca67-1905-4598-9925-e21c27ef6018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:01.884561 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d482ca67-1905-4598-9925-e21c27ef6018 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:01.992478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482ca67-1905-4598-9925-e21c27ef6018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:28:01.994429 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482ca67-1905-4598-9925-e21c27ef6018 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:28:02.013112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 752/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:28:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:28:02.380224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a9985-55c6-4ced-913a-6199bb694fd2 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:28:02.381454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-370a9985-55c6-4ced-913a-6199bb694fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:02.393919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a9985-55c6-4ced-913a-6199bb694fd2 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:28:02.502483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e3fab-80b4-40eb-9430-662a92e8a792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:28:02.503141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e3fab-80b4-40eb-9430-662a92e8a792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:02.503421 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e3fab-80b4-40eb-9430-662a92e8a792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:02.503692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e3fab-80b4-40eb-9430-662a92e8a792 admin admin] PATH_INFO: `/v3/projects/e6495b4b0e324c2e893b22e2195dd7a0` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:02.514982 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e3fab-80b4-40eb-9430-662a92e8a792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6495b4b0e324c2e893b22e2195dd7a0)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:28:02.516796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: WARNING py.warnings [None req-c31e3fab-80b4-40eb-9430-662a92e8a792 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:28:02.516796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: warnings.warn(msg) Sep 24 19:28:02.516796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: Sep 24 19:28:02.517195 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e3fab-80b4-40eb-9430-662a92e8a792 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:28:02.574794 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c31e3fab-80b4-40eb-9430-662a92e8a792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6495b4b0e324c2e893b22e2195dd7a0', 'request_id': 'req-c31e3fab-80b4-40eb-9430-662a92e8a792'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:28:02.580824 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c31e3fab-80b4-40eb-9430-662a92e8a792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6495b4b0e324c2e893b22e2195dd7a0', 'request_id': 'req-c31e3fab-80b4-40eb-9430-662a92e8a792'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:28:02.594045 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c31e3fab-80b4-40eb-9430-662a92e8a792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6495b4b0e324c2e893b22e2195dd7a0', 'request_id': 'req-c31e3fab-80b4-40eb-9430-662a92e8a792'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:28:02.620441 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c31e3fab-80b4-40eb-9430-662a92e8a792 admin admin] The token cache is being invalidate because project e6495b4b0e324c2e893b22e2195dd7a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:28:02.620736 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c31e3fab-80b4-40eb-9430-662a92e8a792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:28:02.621251 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-c31e3fab-80b4-40eb-9430-662a92e8a792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:28:02.622557 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 758/1510] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Sep 24 19:28:02 2022] DELETE /identity/v3/projects/e6495b4b0e324c2e893b22e2195dd7a0 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:28:12.010775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=62 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:28:12.618431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:29:23.475216 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33a254-5216-4899-8e60-4cd62038e562 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:23.475767 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33a254-5216-4899-8e60-4cd62038e562 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:23.475767 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33a254-5216-4899-8e60-4cd62038e562 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:23.477890 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:29:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:29:23.482886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b45e0-9e31-45d6-ac57-aa439a9a7c9d None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:23.483303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b45e0-9e31-45d6-ac57-aa439a9a7c9d None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:23.483463 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b45e0-9e31-45d6-ac57-aa439a9a7c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:23.563386 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-6f7b45e0-9e31-45d6-ac57-aa439a9a7c9d None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:29:23.564567 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-6f7b45e0-9e31-45d6-ac57-aa439a9a7c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:29:23.667032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:29:23.826940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33a254-5216-4899-8e60-4cd62038e562 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:29:23.829211 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7f33a254-5216-4899-8e60-4cd62038e562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:29:23.947932 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33a254-5216-4899-8e60-4cd62038e562 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:29:23.953344 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab8552-5304-41f6-93d6-ac13f3bbbe16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:29:23.953941 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab8552-5304-41f6-93d6-ac13f3bbbe16 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:23.954219 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab8552-5304-41f6-93d6-ac13f3bbbe16 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:23.954490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab8552-5304-41f6-93d6-ac13f3bbbe16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:23.963454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab8552-5304-41f6-93d6-ac13f3bbbe16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:29:23.965038 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab8552-5304-41f6-93d6-ac13f3bbbe16 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:29:23.974554 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 754/1513] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:29:25.059797 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae8c12-4fc5-4968-a1e7-d8f1cceb9491 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:25.060386 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae8c12-4fc5-4968-a1e7-d8f1cceb9491 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:25.060386 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae8c12-4fc5-4968-a1e7-d8f1cceb9491 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:25.061657 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:29:25.067835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6d486-3abe-44b8-8f58-4d5bc0101ab9 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:25.068260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6d486-3abe-44b8-8f58-4d5bc0101ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:25.068372 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6d486-3abe-44b8-8f58-4d5bc0101ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:25.088489 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-0ce6d486-3abe-44b8-8f58-4d5bc0101ab9 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:29:25.089687 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-0ce6d486-3abe-44b8-8f58-4d5bc0101ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:29:25.097492 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:29:25.251167 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae8c12-4fc5-4968-a1e7-d8f1cceb9491 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:29:25.266431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae8c12-4fc5-4968-a1e7-d8f1cceb9491 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:29:25.271823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba971e7-6687-4102-afa1-db76929afb49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:29:25.272417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba971e7-6687-4102-afa1-db76929afb49 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:25.272694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba971e7-6687-4102-afa1-db76929afb49 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:25.272965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba971e7-6687-4102-afa1-db76929afb49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:25.282027 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba971e7-6687-4102-afa1-db76929afb49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:29:25.283666 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba971e7-6687-4102-afa1-db76929afb49 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:29:25.293278 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 761/1516] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:29:27.518093 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73be5e6-44a4-4e57-8676-84ab807b9b3a None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:27.518677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73be5e6-44a4-4e57-8676-84ab807b9b3a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:27.518677 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73be5e6-44a4-4e57-8676-84ab807b9b3a None None] PATH_INFO: `/v3` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:27.519987 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 756/1517] 10.222.0.48 () {54 vars in 925 bytes} [Sat Sep 24 19:29:27 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:29:27.527008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408fcb5-d67e-4661-a26e-436f4aa5e11f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:27.527415 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408fcb5-d67e-4661-a26e-436f4aa5e11f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:27.527580 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408fcb5-d67e-4661-a26e-436f4aa5e11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:27.589170 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-1408fcb5-d67e-4661-a26e-436f4aa5e11f None None] MFA Rules not processed for user `95a375bda898420fb9df08d514bf9bff`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:29:27.590365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1408fcb5-d67e-4661-a26e-436f4aa5e11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:29:27.607671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:29:27.663408 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 762/1518] 10.222.0.48 () {58 vars in 1015 bytes} [Sat Sep 24 19:29:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:29:35.083537 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=56 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:29:36.520652 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8fc8d-8358-4db6-91e9-d36a01846d8f None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:36.521276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8fc8d-8358-4db6-91e9-d36a01846d8f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:36.521276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8fc8d-8358-4db6-91e9-d36a01846d8f None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:36.522523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 757/1519] 10.222.0.25 () {54 vars in 961 bytes} [Sat Sep 24 19:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:29:36.529222 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d588ca-cc56-43e6-9e0e-48811a9716ae None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:36.529697 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d588ca-cc56-43e6-9e0e-48811a9716ae None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:36.529988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d588ca-cc56-43e6-9e0e-48811a9716ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:36.550405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-78d588ca-cc56-43e6-9e0e-48811a9716ae None None] MFA Rules not processed for user `95a375bda898420fb9df08d514bf9bff`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:29:36.551647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-78d588ca-cc56-43e6-9e0e-48811a9716ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:29:36.560421 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 763/1520] 10.222.0.25 () {58 vars in 1058 bytes} [Sat Sep 24 19:29:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:29:36.568048 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8fc8d-8358-4db6-91e9-d36a01846d8f None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:29:36.581904 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8fc8d-8358-4db6-91e9-d36a01846d8f None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:29:36.587621 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffcc886-4194-449a-b020-4680963a021f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a375bda898420fb9df08d514bf9bff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:29:36.588222 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcc886-4194-449a-b020-4680963a021f service placement] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:36.588498 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcc886-4194-449a-b020-4680963a021f service placement] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:36.588767 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcc886-4194-449a-b020-4680963a021f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:36.597047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffcc886-4194-449a-b020-4680963a021f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:29:36.598617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffcc886-4194-449a-b020-4680963a021f service placement] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:29:36.608467 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 758/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:29:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:29:36.781817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa1dfc-2475-4d0a-bf7b-cbd0bc45ec60 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:36.782237 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa1dfc-2475-4d0a-bf7b-cbd0bc45ec60 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:36.782519 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa1dfc-2475-4d0a-bf7b-cbd0bc45ec60 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:36.783962 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:29:36.794323 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f88fa8-591f-4072-a415-7db2b166f072 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:36.794613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f88fa8-591f-4072-a415-7db2b166f072 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:36.794923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f88fa8-591f-4072-a415-7db2b166f072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:36.814350 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-06f88fa8-591f-4072-a415-7db2b166f072 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:29:36.815586 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-06f88fa8-591f-4072-a415-7db2b166f072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:29:36.824123 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:29:36.981181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa1dfc-2475-4d0a-bf7b-cbd0bc45ec60 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:29:36.996634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa1dfc-2475-4d0a-bf7b-cbd0bc45ec60 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:29:37.001996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e4138-b7c2-420b-8589-39cf0bd6cc96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:29:37.002590 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e4138-b7c2-420b-8589-39cf0bd6cc96 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:37.002895 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e4138-b7c2-420b-8589-39cf0bd6cc96 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:37.003169 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e4138-b7c2-420b-8589-39cf0bd6cc96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:37.012236 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e4138-b7c2-420b-8589-39cf0bd6cc96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:29:37.013812 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e4138-b7c2-420b-8589-39cf0bd6cc96 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:29:37.024539 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 765/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:29:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:29:38.118443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe9cd6-37b5-4fcc-b5c9-9e9aa01a5709 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:38.119001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe9cd6-37b5-4fcc-b5c9-9e9aa01a5709 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:38.119001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe9cd6-37b5-4fcc-b5c9-9e9aa01a5709 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:38.120294 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:29:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:29:38.126394 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179038f-9ef8-4fc0-ab87-5ea18edbf700 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:38.126863 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179038f-9ef8-4fc0-ab87-5ea18edbf700 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:38.126976 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179038f-9ef8-4fc0-ab87-5ea18edbf700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:38.146577 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-a179038f-9ef8-4fc0-ab87-5ea18edbf700 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:29:38.147815 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-a179038f-9ef8-4fc0-ab87-5ea18edbf700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:29:38.155911 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:29:38.307149 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe9cd6-37b5-4fcc-b5c9-9e9aa01a5709 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:29:38.321786 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe9cd6-37b5-4fcc-b5c9-9e9aa01a5709 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:29:38.327328 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b3ace-ee69-444f-b773-c5ac5004e9b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:29:38.327922 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b3ace-ee69-444f-b773-c5ac5004e9b3 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:38.328201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b3ace-ee69-444f-b773-c5ac5004e9b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:38.328475 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b3ace-ee69-444f-b773-c5ac5004e9b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:38.337250 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b3ace-ee69-444f-b773-c5ac5004e9b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:29:38.338848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b3ace-ee69-444f-b773-c5ac5004e9b3 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:29:38.348183 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 761/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:29:42.514272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb1ccd-1472-43c4-924e-1838edb2f454 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:42.514876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb1ccd-1472-43c4-924e-1838edb2f454 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:42.514876 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb1ccd-1472-43c4-924e-1838edb2f454 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:42.516192 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:29:42.521980 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9b6a7-1ce3-4f1b-9de5-359296955e6e None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:42.522427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9b6a7-1ce3-4f1b-9de5-359296955e6e None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:42.522532 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9b6a7-1ce3-4f1b-9de5-359296955e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:42.542508 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-d3f9b6a7-1ce3-4f1b-9de5-359296955e6e None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:29:42.543735 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d3f9b6a7-1ce3-4f1b-9de5-359296955e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:29:42.551538 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:29:42.845391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb1ccd-1472-43c4-924e-1838edb2f454 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:29:42.847130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d4eb1ccd-1472-43c4-924e-1838edb2f454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:29:42.926065 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb1ccd-1472-43c4-924e-1838edb2f454 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:29:42.930288 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a22053-13d2-4d92-bda3-da4171278b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:29:42.930974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a22053-13d2-4d92-bda3-da4171278b94 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:42.931251 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a22053-13d2-4d92-bda3-da4171278b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:42.931524 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a22053-13d2-4d92-bda3-da4171278b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:42.940760 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a22053-13d2-4d92-bda3-da4171278b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:29:42.942168 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a22053-13d2-4d92-bda3-da4171278b94 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:29:42.952424 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 768/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:29:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:29:45.114301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa160f-9a2e-436b-a15c-84c49dc28254 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:45.115286 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa160f-9a2e-436b-a15c-84c49dc28254 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:45.115581 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa160f-9a2e-436b-a15c-84c49dc28254 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:45.117918 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:29:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:29:45.123571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8226fc-e510-40ca-8d60-7a12fb90a967 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:45.124009 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8226fc-e510-40ca-8d60-7a12fb90a967 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:45.124119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8226fc-e510-40ca-8d60-7a12fb90a967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:45.144306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-df8226fc-e510-40ca-8d60-7a12fb90a967 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:29:45.145502 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-df8226fc-e510-40ca-8d60-7a12fb90a967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:29:45.153260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:29:45.440807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa160f-9a2e-436b-a15c-84c49dc28254 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:29:45.452286 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa160f-9a2e-436b-a15c-84c49dc28254 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:29:45.455818 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902013d4-d75d-47eb-a362-48a86fe132ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:29:45.456412 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902013d4-d75d-47eb-a362-48a86fe132ca service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:45.456690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902013d4-d75d-47eb-a362-48a86fe132ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:45.456961 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902013d4-d75d-47eb-a362-48a86fe132ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:45.465757 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902013d4-d75d-47eb-a362-48a86fe132ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:29:45.467222 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902013d4-d75d-47eb-a362-48a86fe132ca service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:29:45.476871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 764/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:29:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:29:49.837489 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b7acd-4b87-4655-a709-6099c832746e None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:49.838102 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b7acd-4b87-4655-a709-6099c832746e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:49.838102 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b7acd-4b87-4655-a709-6099c832746e None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:49.839357 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:29:49.844527 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446eb45-699b-48a4-808e-4886be06646f None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:49.845006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446eb45-699b-48a4-808e-4886be06646f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:49.845106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446eb45-699b-48a4-808e-4886be06646f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:49.866845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-2446eb45-699b-48a4-808e-4886be06646f None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:29:49.868095 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2446eb45-699b-48a4-808e-4886be06646f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:29:49.875878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:29:50.187303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b7acd-4b87-4655-a709-6099c832746e None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:29:50.188969 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-8e8b7acd-4b87-4655-a709-6099c832746e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:29:50.252954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:29:50.266629 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b7acd-4b87-4655-a709-6099c832746e None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:29:50.270169 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f69d36-c865-4203-9c42-f0e9417da15d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5840a13ddf8c45f2bf97a4f6d4a48d96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:29:50.270758 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f69d36-c865-4203-9c42-f0e9417da15d service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:50.271060 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f69d36-c865-4203-9c42-f0e9417da15d service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:50.271329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f69d36-c865-4203-9c42-f0e9417da15d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:50.280440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f69d36-c865-4203-9c42-f0e9417da15d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:29:50.281851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f69d36-c865-4203-9c42-f0e9417da15d service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:29:50.291812 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 771/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:29:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:29:52.453513 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01342c7-4f48-405b-8403-699a69827f34 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:52.454024 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01342c7-4f48-405b-8403-699a69827f34 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:52.454127 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01342c7-4f48-405b-8403-699a69827f34 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:52.455427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:29:52.461415 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b38a13-ad92-4c99-b8cd-b631e6c71484 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:52.461845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b38a13-ad92-4c99-b8cd-b631e6c71484 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:52.461956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b38a13-ad92-4c99-b8cd-b631e6c71484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:52.481343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-c7b38a13-ad92-4c99-b8cd-b631e6c71484 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:29:52.482544 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c7b38a13-ad92-4c99-b8cd-b631e6c71484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:29:52.490668 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:29:52.794698 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01342c7-4f48-405b-8403-699a69827f34 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:29:52.796420 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-a01342c7-4f48-405b-8403-699a69827f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:29:52.809944 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01342c7-4f48-405b-8403-699a69827f34 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:29:52.813521 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a787a-4c0e-49ba-80c3-bb117f7e6f79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5840a13ddf8c45f2bf97a4f6d4a48d96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:29:52.814112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a787a-4c0e-49ba-80c3-bb117f7e6f79 service cinder] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:52.814390 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a787a-4c0e-49ba-80c3-bb117f7e6f79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:52.814662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a787a-4c0e-49ba-80c3-bb117f7e6f79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:52.824071 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a787a-4c0e-49ba-80c3-bb117f7e6f79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:29:52.825473 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a787a-4c0e-49ba-80c3-bb117f7e6f79 service cinder] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:29:52.834660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 767/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:29:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:30:02.476557 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=11 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:30:02.830484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=33 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:31:13.523390 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8edc9-3c2c-448c-937d-31acdae1ed1c None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:13.524053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8edc9-3c2c-448c-937d-31acdae1ed1c None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:13.524053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8edc9-3c2c-448c-937d-31acdae1ed1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:13.531713 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440fd77-fc3e-401a-bb01-60296db0577d None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:13.532151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440fd77-fc3e-401a-bb01-60296db0577d None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:13.532260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440fd77-fc3e-401a-bb01-60296db0577d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:13.543872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-07f8edc9-3c2c-448c-937d-31acdae1ed1c None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:13.545074 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-07f8edc9-3c2c-448c-937d-31acdae1ed1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:13.551021 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-0440fd77-fc3e-401a-bb01-60296db0577d None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:13.552188 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-0440fd77-fc3e-401a-bb01-60296db0577d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:13.553051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 773/1540] 10.222.0.25 () {58 vars in 958 bytes} [Sat Sep 24 19:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:31:13.560553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 768/1541] 10.222.0.25 () {58 vars in 958 bytes} [Sat Sep 24 19:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:31:13.568763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f6afc-65e7-4d49-a019-53903b78073a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:13.568962 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f6afc-65e7-4d49-a019-53903b78073a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:13.569066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7b851-181a-4ee8-b655-ec855cf42667 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:13.569929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f6afc-65e7-4d49-a019-53903b78073a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:13.570357 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7b851-181a-4ee8-b655-ec855cf42667 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:13.570643 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7b851-181a-4ee8-b655-ec855cf42667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:13.589608 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-ed4f6afc-65e7-4d49-a019-53903b78073a None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:13.589817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-c6b7b851-181a-4ee8-b655-ec855cf42667 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:13.590814 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ed4f6afc-65e7-4d49-a019-53903b78073a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:13.590962 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c6b7b851-181a-4ee8-b655-ec855cf42667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:13.598779 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 769/1543] 10.222.0.25 () {58 vars in 958 bytes} [Sat Sep 24 19:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:31:13.598951 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 774/1543] 10.222.0.25 () {58 vars in 958 bytes} [Sat Sep 24 19:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:31:13.603184 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f6afc-65e7-4d49-a019-53903b78073a None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:13.603421 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7b851-181a-4ee8-b655-ec855cf42667 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:13.612144 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7b851-181a-4ee8-b655-ec855cf42667 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:13.612296 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f6afc-65e7-4d49-a019-53903b78073a None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:13.617439 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5655cc9-da23-4613-8bb8-ab0d8df99584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:13.617841 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4f425-69e7-4e86-b6c8-4350502408c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:13.618025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5655cc9-da23-4613-8bb8-ab0d8df99584 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:13.618307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5655cc9-da23-4613-8bb8-ab0d8df99584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:13.618412 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4f425-69e7-4e86-b6c8-4350502408c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:13.618577 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5655cc9-da23-4613-8bb8-ab0d8df99584 admin admin] PATH_INFO: `/v3/domains` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:13.618691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4f425-69e7-4e86-b6c8-4350502408c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:13.618984 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4f425-69e7-4e86-b6c8-4350502408c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:13.619248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5655cc9-da23-4613-8bb8-ab0d8df99584 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:31:13.619551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5655cc9-da23-4613-8bb8-ab0d8df99584 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:13.619665 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4f425-69e7-4e86-b6c8-4350502408c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:31:13.619905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4f425-69e7-4e86-b6c8-4350502408c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:13.620562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: WARNING py.warnings [None req-b5655cc9-da23-4613-8bb8-ab0d8df99584 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:31:13.620562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: warnings.warn(msg) Sep 24 19:31:13.620562 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: Sep 24 19:31:13.621440 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5655cc9-da23-4613-8bb8-ab0d8df99584 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:13.621553 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4f425-69e7-4e86-b6c8-4350502408c3 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:13.633878 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 770/1544] 10.222.0.25 () {58 vars in 1153 bytes} [Sat Sep 24 19:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:31:13.639003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 775/1545] 10.222.0.25 () {58 vars in 1153 bytes} [Sat Sep 24 19:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:31:13.641746 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4f425-69e7-4e86-b6c8-4350502408c3 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:13.641881 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5655cc9-da23-4613-8bb8-ab0d8df99584 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:13.651596 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5655cc9-da23-4613-8bb8-ab0d8df99584 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:13.652353 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4f425-69e7-4e86-b6c8-4350502408c3 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:13.656643 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7706f05-a9f7-442a-8b40-965a60ce51bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:13.657164 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690937e7-1e10-448a-a73f-51d852df1eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:13.657298 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7706f05-a9f7-442a-8b40-965a60ce51bd admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:13.657507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7706f05-a9f7-442a-8b40-965a60ce51bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:13.657743 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690937e7-1e10-448a-a73f-51d852df1eec admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:13.657845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7706f05-a9f7-442a-8b40-965a60ce51bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:13.658018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690937e7-1e10-448a-a73f-51d852df1eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:13.658288 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690937e7-1e10-448a-a73f-51d852df1eec admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:13.658393 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7706f05-a9f7-442a-8b40-965a60ce51bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:13.658929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690937e7-1e10-448a-a73f-51d852df1eec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:13.659929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: WARNING py.warnings [None req-690937e7-1e10-448a-a73f-51d852df1eec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:31:13.659929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: warnings.warn(msg) Sep 24 19:31:13.659929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: Sep 24 19:31:13.660428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7706f05-a9f7-442a-8b40-965a60ce51bd admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:13.661136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690937e7-1e10-448a-a73f-51d852df1eec admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:13.698892 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 771/1546] 10.222.0.25 () {60 vars in 1153 bytes} [Sat Sep 24 19:31:13 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:31:13.703239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 776/1547] 10.222.0.25 () {60 vars in 1153 bytes} [Sat Sep 24 19:31:13 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:31:13.703400 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7706f05-a9f7-442a-8b40-965a60ce51bd admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:13.704215 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690937e7-1e10-448a-a73f-51d852df1eec admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:13.764757 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7706f05-a9f7-442a-8b40-965a60ce51bd admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:13.766737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690937e7-1e10-448a-a73f-51d852df1eec admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:13.769466 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c85ff-d096-418a-963b-3851ad5321ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:13.770080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c85ff-d096-418a-963b-3851ad5321ed admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:13.770358 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c85ff-d096-418a-963b-3851ad5321ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:13.770631 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c85ff-d096-418a-963b-3851ad5321ed admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:13.771282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c85ff-d096-418a-963b-3851ad5321ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:13.771465 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69049003-dabd-40c0-a4ee-6314c278c9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:13.772060 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69049003-dabd-40c0-a4ee-6314c278c9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:13.772843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: WARNING py.warnings [None req-ad2c85ff-d096-418a-963b-3851ad5321ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:31:13.772843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: warnings.warn(msg) Sep 24 19:31:13.772843 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: Sep 24 19:31:13.773124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69049003-dabd-40c0-a4ee-6314c278c9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:13.773633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69049003-dabd-40c0-a4ee-6314c278c9e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:13.774255 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69049003-dabd-40c0-a4ee-6314c278c9e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:13.774417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c85ff-d096-418a-963b-3851ad5321ed admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:13.776159 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69049003-dabd-40c0-a4ee-6314c278c9e7 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:13.799101 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 772/1548] 10.222.0.25 () {60 vars in 1144 bytes} [Sat Sep 24 19:31:13 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:31:13.799945 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 777/1549] 10.222.0.25 () {60 vars in 1144 bytes} [Sat Sep 24 19:31:13 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:31:13.805674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69049003-dabd-40c0-a4ee-6314c278c9e7 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:13.805833 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c85ff-d096-418a-963b-3851ad5321ed admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:13.815657 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69049003-dabd-40c0-a4ee-6314c278c9e7 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:13.815813 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c85ff-d096-418a-963b-3851ad5321ed admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:13.820597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb4bae-c39e-475a-8d56-61f0bf7125d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:13.821080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7868b-f950-4ac8-808d-b663008a8ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:13.821206 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb4bae-c39e-475a-8d56-61f0bf7125d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:13.821463 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb4bae-c39e-475a-8d56-61f0bf7125d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:13.821673 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7868b-f950-4ac8-808d-b663008a8ffc admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:13.821791 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb4bae-c39e-475a-8d56-61f0bf7125d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:13.821949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7868b-f950-4ac8-808d-b663008a8ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:13.822221 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7868b-f950-4ac8-808d-b663008a8ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:13.822354 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb4bae-c39e-475a-8d56-61f0bf7125d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:13.822909 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7868b-f950-4ac8-808d-b663008a8ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:13.824000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb4bae-c39e-475a-8d56-61f0bf7125d2 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:13.824483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7868b-f950-4ac8-808d-b663008a8ffc admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:13.834679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 773/1550] 10.222.0.25 () {58 vars in 1122 bytes} [Sat Sep 24 19:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:31:13.838212 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 778/1551] 10.222.0.25 () {58 vars in 1122 bytes} [Sat Sep 24 19:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:31:13.839260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7868b-f950-4ac8-808d-b663008a8ffc admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:13.839390 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb4bae-c39e-475a-8d56-61f0bf7125d2 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:13.848950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7868b-f950-4ac8-808d-b663008a8ffc admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:13.849087 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb4bae-c39e-475a-8d56-61f0bf7125d2 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:13.854303 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb59df-52c1-4036-9785-edbc126c419d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:13.854704 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7975be-b278-4437-913c-73287d90f47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:13.854917 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb59df-52c1-4036-9785-edbc126c419d admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:13.855198 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb59df-52c1-4036-9785-edbc126c419d admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:13.855330 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7975be-b278-4437-913c-73287d90f47f admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:13.855470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb59df-52c1-4036-9785-edbc126c419d admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:13.855613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7975be-b278-4437-913c-73287d90f47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:13.855884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7975be-b278-4437-913c-73287d90f47f admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:13.856125 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb59df-52c1-4036-9785-edbc126c419d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:13.856515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7975be-b278-4437-913c-73287d90f47f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:13.857734 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb59df-52c1-4036-9785-edbc126c419d admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:13.858078 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7975be-b278-4437-913c-73287d90f47f admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:13.868203 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 779/1552] 10.222.0.25 () {58 vars in 1122 bytes} [Sat Sep 24 19:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:31:13.868883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 774/1553] 10.222.0.25 () {58 vars in 1122 bytes} [Sat Sep 24 19:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:31:13.872375 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb59df-52c1-4036-9785-edbc126c419d admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:13.872795 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7975be-b278-4437-913c-73287d90f47f admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:13.882374 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb59df-52c1-4036-9785-edbc126c419d admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:13.883381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7975be-b278-4437-913c-73287d90f47f admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:13.887364 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1d13e-8ad3-4499-8f73-b496b7db09d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:13.888041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1d13e-8ad3-4499-8f73-b496b7db09d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:13.888157 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def5cbb-f9b6-45b5-9a39-a991b9aeec4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:13.888344 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1d13e-8ad3-4499-8f73-b496b7db09d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:13.888589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1d13e-8ad3-4499-8f73-b496b7db09d8 admin admin] PATH_INFO: `/v3/projects/39d6e4e81862451998909c5eedfe9841/users/ea311a3ffec74f2285505b177504a75b/roles/ef0525432e044dd18b3ae4b32d29030e` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:13.888849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def5cbb-f9b6-45b5-9a39-a991b9aeec4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:13.889132 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def5cbb-f9b6-45b5-9a39-a991b9aeec4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:13.889404 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def5cbb-f9b6-45b5-9a39-a991b9aeec4a admin admin] PATH_INFO: `/v3/projects/9428889910ee424da582b09a939bcf4d/users/a55ca211737b42938212daed08bb05d6/roles/ef0525432e044dd18b3ae4b32d29030e` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:13.903777 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1d13e-8ad3-4499-8f73-b496b7db09d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d6e4e81862451998909c5eedfe9841, user_id=ea311a3ffec74f2285505b177504a75b, role_id=ef0525432e044dd18b3ae4b32d29030e)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:13.905054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: WARNING py.warnings [None req-8fb1d13e-8ad3-4499-8f73-b496b7db09d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:31:13.905054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: warnings.warn(msg) Sep 24 19:31:13.905054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: Sep 24 19:31:13.905483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def5cbb-f9b6-45b5-9a39-a991b9aeec4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9428889910ee424da582b09a939bcf4d, user_id=a55ca211737b42938212daed08bb05d6, role_id=ef0525432e044dd18b3ae4b32d29030e)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:13.907006 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1d13e-8ad3-4499-8f73-b496b7db09d8 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:13.908145 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def5cbb-f9b6-45b5-9a39-a991b9aeec4a admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:13.921031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 780/1554] 10.222.0.25 () {60 vars in 1483 bytes} [Sat Sep 24 19:31:13 2022] PUT /identity/v3/projects/39d6e4e81862451998909c5eedfe9841/users/ea311a3ffec74f2285505b177504a75b/roles/ef0525432e044dd18b3ae4b32d29030e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:31:13.922470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 775/1555] 10.222.0.25 () {60 vars in 1483 bytes} [Sat Sep 24 19:31:13 2022] PUT /identity/v3/projects/9428889910ee424da582b09a939bcf4d/users/a55ca211737b42938212daed08bb05d6/roles/ef0525432e044dd18b3ae4b32d29030e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:31:13.926126 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ba49b-c29a-4ec7-8a52-420c7f075c51 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:13.926415 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ba49b-c29a-4ec7-8a52-420c7f075c51 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:13.926692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ba49b-c29a-4ec7-8a52-420c7f075c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:13.927170 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09223b5-e978-4cf7-99c8-2155e70251d8 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:13.927499 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09223b5-e978-4cf7-99c8-2155e70251d8 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:13.927811 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09223b5-e978-4cf7-99c8-2155e70251d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:13.946461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-229ba49b-c29a-4ec7-8a52-420c7f075c51 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:13.946759 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-b09223b5-e978-4cf7-99c8-2155e70251d8 None None] MFA Rules not processed for user `a348fc63930b48c2bf96319b964824d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:13.947975 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b09223b5-e978-4cf7-99c8-2155e70251d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:13.948166 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-229ba49b-c29a-4ec7-8a52-420c7f075c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:13.991255 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:31:13.993836 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:31:14.011714 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 776/1556] 10.222.0.25 () {58 vars in 958 bytes} [Sat Sep 24 19:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:31:14.016175 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 781/1557] 10.222.0.25 () {58 vars in 958 bytes} [Sat Sep 24 19:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:31:14.025647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09223b5-e978-4cf7-99c8-2155e70251d8 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:14.027108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ba49b-c29a-4ec7-8a52-420c7f075c51 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:14.028671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-229ba49b-c29a-4ec7-8a52-420c7f075c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:14.080020 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09223b5-e978-4cf7-99c8-2155e70251d8 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:14.083742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9bd76-afbb-47df-bc74-5027be221333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:14.084351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9bd76-afbb-47df-bc74-5027be221333 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:14.084633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9bd76-afbb-47df-bc74-5027be221333 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:14.085535 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9bd76-afbb-47df-bc74-5027be221333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:14.087165 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ba49b-c29a-4ec7-8a52-420c7f075c51 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:14.090960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961bbef-17e5-4bf3-8cec-7be0a1ef6fec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:14.091576 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961bbef-17e5-4bf3-8cec-7be0a1ef6fec service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:14.092014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961bbef-17e5-4bf3-8cec-7be0a1ef6fec service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:14.092290 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961bbef-17e5-4bf3-8cec-7be0a1ef6fec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:14.094722 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9bd76-afbb-47df-bc74-5027be221333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:14.096183 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9bd76-afbb-47df-bc74-5027be221333 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:14.102131 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961bbef-17e5-4bf3-8cec-7be0a1ef6fec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:14.103577 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961bbef-17e5-4bf3-8cec-7be0a1ef6fec service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:14.106709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 777/1558] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:31:14.113130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 782/1559] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:31:18.997108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33bcdc-ff92-453c-ae77-122d9513b5cd None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:18.997680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33bcdc-ff92-453c-ae77-122d9513b5cd None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:18.997834 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33bcdc-ff92-453c-ae77-122d9513b5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:19.041169 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-1b33bcdc-ff92-453c-ae77-122d9513b5cd None None] MFA Rules not processed for user `a55ca211737b42938212daed08bb05d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:19.042657 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-1b33bcdc-ff92-453c-ae77-122d9513b5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:19.140005 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 778/1560] 10.222.0.25 () {58 vars in 958 bytes} [Sat Sep 24 19:31:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:31:19.144314 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961bbef-17e5-4bf3-8cec-7be0a1ef6fec service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:19.159094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961bbef-17e5-4bf3-8cec-7be0a1ef6fec service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:19.169395 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440343c1-7972-4b72-93ab-e2a73ba668b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:19.170283 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440343c1-7972-4b72-93ab-e2a73ba668b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:19.171432 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440343c1-7972-4b72-93ab-e2a73ba668b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:19.171823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440343c1-7972-4b72-93ab-e2a73ba668b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:19.174738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440343c1-7972-4b72-93ab-e2a73ba668b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:19.177855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440343c1-7972-4b72-93ab-e2a73ba668b0 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:19.215069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 783/1561] 10.222.0.25 () {60 vars in 1153 bytes} [Sat Sep 24 19:31:19 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:31:19.219429 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33bcdc-ff92-453c-ae77-122d9513b5cd None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:19.235561 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33bcdc-ff92-453c-ae77-122d9513b5cd None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:19.329754 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbed300-3b78-4866-91c3-dba646c04a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:19.330769 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbed300-3b78-4866-91c3-dba646c04a55 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:19.330769 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbed300-3b78-4866-91c3-dba646c04a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:19.331016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbed300-3b78-4866-91c3-dba646c04a55 admin admin] PATH_INFO: `/v3/users` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:19.331597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbed300-3b78-4866-91c3-dba646c04a55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:19.333923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbed300-3b78-4866-91c3-dba646c04a55 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:19.374919 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 779/1562] 10.222.0.25 () {60 vars in 1144 bytes} [Sat Sep 24 19:31:19 2022] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:31:19.376293 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440343c1-7972-4b72-93ab-e2a73ba668b0 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:19.395905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440343c1-7972-4b72-93ab-e2a73ba668b0 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:19.402754 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c09b4d-a678-471e-b72f-823d17a78e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:19.403512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c09b4d-a678-471e-b72f-823d17a78e86 admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:19.403871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c09b4d-a678-471e-b72f-823d17a78e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:19.404215 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c09b4d-a678-471e-b72f-823d17a78e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:19.405276 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c09b4d-a678-471e-b72f-823d17a78e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:19.407105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c09b4d-a678-471e-b72f-823d17a78e86 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:19.422421 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 784/1563] 10.222.0.25 () {58 vars in 1122 bytes} [Sat Sep 24 19:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:31:19.427389 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbed300-3b78-4866-91c3-dba646c04a55 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:19.438215 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbed300-3b78-4866-91c3-dba646c04a55 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:19.443738 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21402f-0bc1-4e1f-a8f2-a61605ac1e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:19.445101 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21402f-0bc1-4e1f-a8f2-a61605ac1e6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:19.445481 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21402f-0bc1-4e1f-a8f2-a61605ac1e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:19.445860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21402f-0bc1-4e1f-a8f2-a61605ac1e6f admin admin] PATH_INFO: `/v3/projects/946b7677835e43c69aca9858b9dd7565/users/29ad7bcac88c44fa93ec3e6817e173f2/roles/dd27845a836a4f6ebece149dbebc59c0` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:19.449632 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:31:19.466593 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21402f-0bc1-4e1f-a8f2-a61605ac1e6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=946b7677835e43c69aca9858b9dd7565, user_id=29ad7bcac88c44fa93ec3e6817e173f2, role_id=dd27845a836a4f6ebece149dbebc59c0)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:19.469606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21402f-0bc1-4e1f-a8f2-a61605ac1e6f admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:19.497238 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 780/1564] 10.222.0.25 () {60 vars in 1483 bytes} [Sat Sep 24 19:31:19 2022] PUT /identity/v3/projects/946b7677835e43c69aca9858b9dd7565/users/29ad7bcac88c44fa93ec3e6817e173f2/roles/dd27845a836a4f6ebece149dbebc59c0 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:31:19.501152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c09b4d-a678-471e-b72f-823d17a78e86 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:19.518893 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c09b4d-a678-471e-b72f-823d17a78e86 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:19.612882 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be1597-f039-4838-a916-bef07b1481df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:19.613520 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be1597-f039-4838-a916-bef07b1481df admin admin] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:19.613806 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be1597-f039-4838-a916-bef07b1481df admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:19.614077 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be1597-f039-4838-a916-bef07b1481df admin admin] PATH_INFO: `/v3/roles` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:19.614730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be1597-f039-4838-a916-bef07b1481df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:19.621103 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be1597-f039-4838-a916-bef07b1481df admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:19.644170 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 785/1565] 10.222.0.25 () {58 vars in 1122 bytes} [Sat Sep 24 19:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:31:19.648444 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21402f-0bc1-4e1f-a8f2-a61605ac1e6f admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:19.676216 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21402f-0bc1-4e1f-a8f2-a61605ac1e6f admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:19.684058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaccfa1-ea59-4e5f-bee6-601f02ee9346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:19.684823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaccfa1-ea59-4e5f-bee6-601f02ee9346 admin admin] REQUEST_METHOD: `PUT` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:19.685177 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaccfa1-ea59-4e5f-bee6-601f02ee9346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:19.685525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaccfa1-ea59-4e5f-bee6-601f02ee9346 admin admin] PATH_INFO: `/v3/projects/946b7677835e43c69aca9858b9dd7565/users/29ad7bcac88c44fa93ec3e6817e173f2/roles/dd27845a836a4f6ebece149dbebc59c0` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:19.689064 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaccfa1-ea59-4e5f-bee6-601f02ee9346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=946b7677835e43c69aca9858b9dd7565, user_id=29ad7bcac88c44fa93ec3e6817e173f2, role_id=dd27845a836a4f6ebece149dbebc59c0)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:19.692017 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaccfa1-ea59-4e5f-bee6-601f02ee9346 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:19.704703 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 781/1566] 10.222.0.25 () {60 vars in 1483 bytes} [Sat Sep 24 19:31:19 2022] PUT /identity/v3/projects/946b7677835e43c69aca9858b9dd7565/users/29ad7bcac88c44fa93ec3e6817e173f2/roles/dd27845a836a4f6ebece149dbebc59c0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:31:19.755626 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8df06-432e-4c02-9d0e-a653114afdda None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:19.755994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8df06-432e-4c02-9d0e-a653114afdda None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:19.756309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8df06-432e-4c02-9d0e-a653114afdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:19.790555 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-68a8df06-432e-4c02-9d0e-a653114afdda None None] MFA Rules not processed for user `ea311a3ffec74f2285505b177504a75b`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:19.793455 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-68a8df06-432e-4c02-9d0e-a653114afdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:19.853540 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:31:19.892211 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 786/1567] 10.222.0.25 () {58 vars in 958 bytes} [Sat Sep 24 19:31:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:31:19.898872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaccfa1-ea59-4e5f-bee6-601f02ee9346 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:20.005225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaccfa1-ea59-4e5f-bee6-601f02ee9346 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:20.012427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6adc18-0bd1-4ab2-8909-24eb3fef32a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:20.014315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6adc18-0bd1-4ab2-8909-24eb3fef32a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:20.014605 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6adc18-0bd1-4ab2-8909-24eb3fef32a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:20.014935 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6adc18-0bd1-4ab2-8909-24eb3fef32a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:20.015602 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6adc18-0bd1-4ab2-8909-24eb3fef32a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:20.017902 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6adc18-0bd1-4ab2-8909-24eb3fef32a5 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:20.071520 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 782/1568] 10.222.0.25 () {60 vars in 1153 bytes} [Sat Sep 24 19:31:19 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:31:20.075606 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8df06-432e-4c02-9d0e-a653114afdda None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:20.097294 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8df06-432e-4c02-9d0e-a653114afdda None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:20.222763 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2508b45-329e-4325-af71-f9c074b587d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:20.223769 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2508b45-329e-4325-af71-f9c074b587d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:20.224058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2508b45-329e-4325-af71-f9c074b587d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:20.224335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2508b45-329e-4325-af71-f9c074b587d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:20.224976 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2508b45-329e-4325-af71-f9c074b587d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:20.227452 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2508b45-329e-4325-af71-f9c074b587d0 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:20.271772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 787/1569] 10.222.0.25 () {60 vars in 1144 bytes} [Sat Sep 24 19:31:20 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:31:20.273479 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6adc18-0bd1-4ab2-8909-24eb3fef32a5 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:20.289441 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6adc18-0bd1-4ab2-8909-24eb3fef32a5 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:20.295463 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64acd003-4e52-4585-88e2-085347b3b320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:20.296092 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acd003-4e52-4585-88e2-085347b3b320 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:20.296374 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acd003-4e52-4585-88e2-085347b3b320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:20.296651 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acd003-4e52-4585-88e2-085347b3b320 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:20.297309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64acd003-4e52-4585-88e2-085347b3b320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:20.299007 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64acd003-4e52-4585-88e2-085347b3b320 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:20.312298 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 783/1570] 10.222.0.25 () {58 vars in 1122 bytes} [Sat Sep 24 19:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:31:20.318131 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2508b45-329e-4325-af71-f9c074b587d0 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:20.341445 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2508b45-329e-4325-af71-f9c074b587d0 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:20.361731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd142fb-9248-4c80-91ca-0a47d3956c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:20.362424 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd142fb-9248-4c80-91ca-0a47d3956c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:20.362703 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd142fb-9248-4c80-91ca-0a47d3956c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:20.363008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd142fb-9248-4c80-91ca-0a47d3956c93 admin admin] PATH_INFO: `/v3/projects/5be6d60982e644fda7462ebd074df7b0/users/e8e3c1674e7043e690be2c09eb4e390a/roles/dd27845a836a4f6ebece149dbebc59c0` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:20.385940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd142fb-9248-4c80-91ca-0a47d3956c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be6d60982e644fda7462ebd074df7b0, user_id=e8e3c1674e7043e690be2c09eb4e390a, role_id=dd27845a836a4f6ebece149dbebc59c0)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:20.388647 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd142fb-9248-4c80-91ca-0a47d3956c93 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:20.414176 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 788/1571] 10.222.0.25 () {60 vars in 1483 bytes} [Sat Sep 24 19:31:20 2022] PUT /identity/v3/projects/5be6d60982e644fda7462ebd074df7b0/users/e8e3c1674e7043e690be2c09eb4e390a/roles/dd27845a836a4f6ebece149dbebc59c0 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:31:20.419454 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64acd003-4e52-4585-88e2-085347b3b320 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:20.440823 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64acd003-4e52-4585-88e2-085347b3b320 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:20.573238 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf9df5-95f5-4eab-a848-d579099db5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:20.574007 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf9df5-95f5-4eab-a848-d579099db5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:20.577005 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf9df5-95f5-4eab-a848-d579099db5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:20.577422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf9df5-95f5-4eab-a848-d579099db5a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:20.578212 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf9df5-95f5-4eab-a848-d579099db5a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:20.580410 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf9df5-95f5-4eab-a848-d579099db5a8 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:20.601827 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 784/1572] 10.222.0.25 () {58 vars in 1122 bytes} [Sat Sep 24 19:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:31:20.606693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd142fb-9248-4c80-91ca-0a47d3956c93 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:20.618405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd142fb-9248-4c80-91ca-0a47d3956c93 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:20.629039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982cd35-1348-4572-9c4e-e2d1ed4d321c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:20.629885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982cd35-1348-4572-9c4e-e2d1ed4d321c admin admin] REQUEST_METHOD: `PUT` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:20.630166 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982cd35-1348-4572-9c4e-e2d1ed4d321c admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:20.630442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982cd35-1348-4572-9c4e-e2d1ed4d321c admin admin] PATH_INFO: `/v3/projects/5be6d60982e644fda7462ebd074df7b0/users/e8e3c1674e7043e690be2c09eb4e390a/roles/dd27845a836a4f6ebece149dbebc59c0` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:20.632998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982cd35-1348-4572-9c4e-e2d1ed4d321c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be6d60982e644fda7462ebd074df7b0, user_id=e8e3c1674e7043e690be2c09eb4e390a, role_id=dd27845a836a4f6ebece149dbebc59c0)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:20.640620 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982cd35-1348-4572-9c4e-e2d1ed4d321c admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:20.678714 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 789/1573] 10.222.0.25 () {60 vars in 1483 bytes} [Sat Sep 24 19:31:20 2022] PUT /identity/v3/projects/5be6d60982e644fda7462ebd074df7b0/users/e8e3c1674e7043e690be2c09eb4e390a/roles/dd27845a836a4f6ebece149dbebc59c0 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:31:25.937192 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cd23b-486e-4a8d-b65a-03554ab592b1 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:25.937651 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cd23b-486e-4a8d-b65a-03554ab592b1 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:25.937736 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cd23b-486e-4a8d-b65a-03554ab592b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:25.984297 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-777cd23b-486e-4a8d-b65a-03554ab592b1 None None] MFA Rules not processed for user `29ad7bcac88c44fa93ec3e6817e173f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:25.985540 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-777cd23b-486e-4a8d-b65a-03554ab592b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:26.049156 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:31:26.148616 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 785/1574] 10.222.0.25 () {58 vars in 958 bytes} [Sat Sep 24 19:31:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:31:26.158417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982cd35-1348-4572-9c4e-e2d1ed4d321c admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:26.162101 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7982cd35-1348-4572-9c4e-e2d1ed4d321c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:26.333132 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982cd35-1348-4572-9c4e-e2d1ed4d321c admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:26.337871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a96cc-33ab-4e5c-9c74-bd76b00fe284 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54232cb318b04e9286f58dae8b2a3fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:26.338948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a96cc-33ab-4e5c-9c74-bd76b00fe284 service glance] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:26.339263 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a96cc-33ab-4e5c-9c74-bd76b00fe284 service glance] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:26.339528 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a96cc-33ab-4e5c-9c74-bd76b00fe284 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:26.397807 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:31:26.457281 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a96cc-33ab-4e5c-9c74-bd76b00fe284 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:26.459036 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a96cc-33ab-4e5c-9c74-bd76b00fe284 service glance] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:26.471397 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 790/1575] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:31:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:31:26.749690 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad086027-3bb2-4cea-9b81-097db2ea9569 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:26.750121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad086027-3bb2-4cea-9b81-097db2ea9569 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:26.750406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad086027-3bb2-4cea-9b81-097db2ea9569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:26.763321 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9bcf2-a5d4-4de7-90c1-d2575564132e None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:26.763601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9bcf2-a5d4-4de7-90c1-d2575564132e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:26.763875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9bcf2-a5d4-4de7-90c1-d2575564132e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:26.793047 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-ad086027-3bb2-4cea-9b81-097db2ea9569 None None] MFA Rules not processed for user `e8e3c1674e7043e690be2c09eb4e390a`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:26.794318 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ad086027-3bb2-4cea-9b81-097db2ea9569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:26.839213 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-1aa9bcf2-a5d4-4de7-90c1-d2575564132e None None] MFA Rules not processed for user `7c398cf6318240f09d2c3b62bc6761d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:26.840561 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1aa9bcf2-a5d4-4de7-90c1-d2575564132e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:26.888348 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 786/1576] 10.222.0.25 () {58 vars in 958 bytes} [Sat Sep 24 19:31:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:31:26.907271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad086027-3bb2-4cea-9b81-097db2ea9569 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:26.919358 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad086027-3bb2-4cea-9b81-097db2ea9569 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:26.921089 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 791/1577] 10.222.0.25 () {58 vars in 1009 bytes} [Sat Sep 24 19:31:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:31:26.923493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d31d9-ee9d-4022-8bb7-8af28f3d4673 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54232cb318b04e9286f58dae8b2a3fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:26.924104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d31d9-ee9d-4022-8bb7-8af28f3d4673 service glance] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:26.924382 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d31d9-ee9d-4022-8bb7-8af28f3d4673 service glance] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:26.924653 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d31d9-ee9d-4022-8bb7-8af28f3d4673 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:26.992594 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d31d9-ee9d-4022-8bb7-8af28f3d4673 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:26.994186 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d31d9-ee9d-4022-8bb7-8af28f3d4673 service glance] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:27.004010 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 787/1578] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:31:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:31:27.027261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9bcf2-a5d4-4de7-90c1-d2575564132e None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:27.028785 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1aa9bcf2-a5d4-4de7-90c1-d2575564132e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:27.135888 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9bcf2-a5d4-4de7-90c1-d2575564132e None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:27.144848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e11a3-18c2-4474-a3b4-b63b90148f42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85b45de73f7b4f7da7e0e8d8375deb37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:27.146119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e11a3-18c2-4474-a3b4-b63b90148f42 service swift] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:27.146709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e11a3-18c2-4474-a3b4-b63b90148f42 service swift] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:27.147851 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e11a3-18c2-4474-a3b4-b63b90148f42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:27.161001 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e11a3-18c2-4474-a3b4-b63b90148f42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:27.163254 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e11a3-18c2-4474-a3b4-b63b90148f42 service swift] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:27.175867 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 792/1579] 10.222.0.25 () {60 vars in 1384 bytes} [Sat Sep 24 19:31:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 19:31:28.917493 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ed4fc-f2af-4ba4-8f5d-8aa9382edb6b None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:28.918106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ed4fc-f2af-4ba4-8f5d-8aa9382edb6b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:28.918106 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ed4fc-f2af-4ba4-8f5d-8aa9382edb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:28.949384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-fc6ed4fc-f2af-4ba4-8f5d-8aa9382edb6b None None] MFA Rules not processed for user `7c398cf6318240f09d2c3b62bc6761d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:28.950948 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-fc6ed4fc-f2af-4ba4-8f5d-8aa9382edb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:28.958793 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 788/1580] 10.222.0.25 () {58 vars in 1009 bytes} [Sat Sep 24 19:31:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:31:28.976783 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e11a3-18c2-4474-a3b4-b63b90148f42 service swift] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:28.994068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e11a3-18c2-4474-a3b4-b63b90148f42 service swift] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:29.000152 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75b869-bb8b-47d1-ae2d-fb3367ceacc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85b45de73f7b4f7da7e0e8d8375deb37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:29.000995 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75b869-bb8b-47d1-ae2d-fb3367ceacc5 service swift] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:29.001423 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75b869-bb8b-47d1-ae2d-fb3367ceacc5 service swift] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:29.001887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75b869-bb8b-47d1-ae2d-fb3367ceacc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:29.013568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75b869-bb8b-47d1-ae2d-fb3367ceacc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:29.016510 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75b869-bb8b-47d1-ae2d-fb3367ceacc5 service swift] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:29.021036 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:31:29.033686 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 793/1581] 10.222.0.25 () {60 vars in 1384 bytes} [Sat Sep 24 19:31:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 19:31:38.171405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e8cd4-abb2-4641-8d4d-f7210323364a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:38.172296 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e8cd4-abb2-4641-8d4d-f7210323364a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:38.172723 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e8cd4-abb2-4641-8d4d-f7210323364a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:38.196943 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-109e8cd4-abb2-4641-8d4d-f7210323364a None None] MFA Rules not processed for user `a55ca211737b42938212daed08bb05d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:38.200016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-109e8cd4-abb2-4641-8d4d-f7210323364a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:38.211765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 789/1582] 10.222.0.25 () {58 vars in 958 bytes} [Sat Sep 24 19:31:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:31:38.519500 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea49971-9648-42e7-8950-12fd02c4b1af None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:38.520031 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea49971-9648-42e7-8950-12fd02c4b1af None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:38.520239 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea49971-9648-42e7-8950-12fd02c4b1af None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:38.522748 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 794/1583] 10.222.0.25 () {54 vars in 961 bytes} [Sat Sep 24 19:31:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:31:38.531166 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ad44b-2b93-404d-930e-f3600090e5f8 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:38.531495 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ad44b-2b93-404d-930e-f3600090e5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:38.531839 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ad44b-2b93-404d-930e-f3600090e5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:38.570484 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-176ad44b-2b93-404d-930e-f3600090e5f8 None None] MFA Rules not processed for user `4e5798be0fa544cf9cf48558e87fcfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:38.571735 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-176ad44b-2b93-404d-930e-f3600090e5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:38.592265 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:31:38.651189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 790/1584] 10.222.0.25 () {58 vars in 1058 bytes} [Sat Sep 24 19:31:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:31:38.657200 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374e233-c37a-4b40-8889-211c73134378 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:38.657707 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374e233-c37a-4b40-8889-211c73134378 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:38.658134 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374e233-c37a-4b40-8889-211c73134378 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:38.660455 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 795/1585] 10.222.0.25 () {54 vars in 912 bytes} [Sat Sep 24 19:31:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:31:38.667058 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f092d1c-c122-419e-8d05-0db97b3ff8a5 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:38.667353 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f092d1c-c122-419e-8d05-0db97b3ff8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:38.667632 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f092d1c-c122-419e-8d05-0db97b3ff8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:38.706068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-2f092d1c-c122-419e-8d05-0db97b3ff8a5 None None] MFA Rules not processed for user `4e5798be0fa544cf9cf48558e87fcfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:38.707338 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-2f092d1c-c122-419e-8d05-0db97b3ff8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:38.717196 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 791/1586] 10.222.0.25 () {58 vars in 1009 bytes} [Sat Sep 24 19:31:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:31:38.729747 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374e233-c37a-4b40-8889-211c73134378 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:38.731470 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7374e233-c37a-4b40-8889-211c73134378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:38.745343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374e233-c37a-4b40-8889-211c73134378 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:38.748929 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6367a9-4d03-4e01-8ae6-c6194956c27b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54232cb318b04e9286f58dae8b2a3fd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:38.749533 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6367a9-4d03-4e01-8ae6-c6194956c27b service glance] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:38.749815 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6367a9-4d03-4e01-8ae6-c6194956c27b service glance] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:38.750086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6367a9-4d03-4e01-8ae6-c6194956c27b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:38.761425 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6367a9-4d03-4e01-8ae6-c6194956c27b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:38.762897 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6367a9-4d03-4e01-8ae6-c6194956c27b service glance] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:38.775227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 796/1587] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:31:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:31:39.190205 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a6b09-c1ca-4cde-80d4-c3be41104545 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:39.190709 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a6b09-c1ca-4cde-80d4-c3be41104545 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:39.191026 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a6b09-c1ca-4cde-80d4-c3be41104545 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:39.193155 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 792/1588] 10.222.0.25 () {54 vars in 912 bytes} [Sat Sep 24 19:31:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:31:39.199221 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483f0d9-0bc8-482b-9b5c-4a08f36db1f3 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:39.199574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483f0d9-0bc8-482b-9b5c-4a08f36db1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:39.199917 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483f0d9-0bc8-482b-9b5c-4a08f36db1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:39.251405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-7483f0d9-0bc8-482b-9b5c-4a08f36db1f3 None None] MFA Rules not processed for user `1763ed41f99a4778b3df6eebcc6d94e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:39.252870 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7483f0d9-0bc8-482b-9b5c-4a08f36db1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:39.318465 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 797/1589] 10.222.0.25 () {58 vars in 1009 bytes} [Sat Sep 24 19:31:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:31:39.330899 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a6b09-c1ca-4cde-80d4-c3be41104545 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:39.341988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a6b09-c1ca-4cde-80d4-c3be41104545 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:39.345535 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485797fe-806b-4602-8a03-c8eb31254034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:39.346126 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485797fe-806b-4602-8a03-c8eb31254034 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:39.346406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485797fe-806b-4602-8a03-c8eb31254034 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:39.346679 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485797fe-806b-4602-8a03-c8eb31254034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:39.353770 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485797fe-806b-4602-8a03-c8eb31254034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:39.355232 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485797fe-806b-4602-8a03-c8eb31254034 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:39.362793 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 793/1590] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:31:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:31:39.872407 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf24625-db0a-459e-966d-0fb37fa36add None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:39.872799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf24625-db0a-459e-966d-0fb37fa36add None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:39.873145 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf24625-db0a-459e-966d-0fb37fa36add None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:39.874699 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485797fe-806b-4602-8a03-c8eb31254034 service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:39.874928 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 798/1591] 10.222.0.25 () {54 vars in 961 bytes} [Sat Sep 24 19:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:31:39.886038 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565bb90-509a-46eb-a186-d7c3d53de28a None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:39.886630 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565bb90-509a-46eb-a186-d7c3d53de28a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:39.887169 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565bb90-509a-46eb-a186-d7c3d53de28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:39.909016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-1565bb90-509a-46eb-a186-d7c3d53de28a None None] MFA Rules not processed for user `4e5798be0fa544cf9cf48558e87fcfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:39.910321 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1565bb90-509a-46eb-a186-d7c3d53de28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:39.920563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 799/1592] 10.222.0.25 () {58 vars in 1058 bytes} [Sat Sep 24 19:31:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:31:39.925894 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c164d6-98c7-4341-b33a-3f5178d748d8 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:39.926245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c164d6-98c7-4341-b33a-3f5178d748d8 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:39.926525 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c164d6-98c7-4341-b33a-3f5178d748d8 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:39.928489 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 800/1593] 10.222.0.25 () {54 vars in 912 bytes} [Sat Sep 24 19:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:31:39.933066 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabfa5f-5368-4c0a-a1ab-b917ffb3a9a9 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:39.933515 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabfa5f-5368-4c0a-a1ab-b917ffb3a9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:39.933794 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabfa5f-5368-4c0a-a1ab-b917ffb3a9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:39.949574 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485797fe-806b-4602-8a03-c8eb31254034 service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:39.954852 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b6c0c-407c-497f-aa3b-a3782614aa27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a375bda898420fb9df08d514bf9bff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:39.955009 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-4dabfa5f-5368-4c0a-a1ab-b917ffb3a9a9 None None] MFA Rules not processed for user `4e5798be0fa544cf9cf48558e87fcfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:39.955617 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b6c0c-407c-497f-aa3b-a3782614aa27 service placement] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:39.955970 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b6c0c-407c-497f-aa3b-a3782614aa27 service placement] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:39.956094 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4dabfa5f-5368-4c0a-a1ab-b917ffb3a9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:39.956375 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b6c0c-407c-497f-aa3b-a3782614aa27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:39.958180 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7b5b6c0c-407c-497f-aa3b-a3782614aa27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:39.965347 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 801/1594] 10.222.0.25 () {58 vars in 1009 bytes} [Sat Sep 24 19:31:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:31:39.969772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b6c0c-407c-497f-aa3b-a3782614aa27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:39.971396 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b6c0c-407c-497f-aa3b-a3782614aa27 service placement] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:39.976844 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabfa5f-5368-4c0a-a1ab-b917ffb3a9a9 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:39.982991 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 794/1595] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:31:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:31:39.986508 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabfa5f-5368-4c0a-a1ab-b917ffb3a9a9 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:39.991941 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d9d6f-8762-4d48-96b6-28b31c8e90b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:39.992597 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d9d6f-8762-4d48-96b6-28b31c8e90b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:39.992869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d9d6f-8762-4d48-96b6-28b31c8e90b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:39.993161 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d9d6f-8762-4d48-96b6-28b31c8e90b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:40.003402 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d9d6f-8762-4d48-96b6-28b31c8e90b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:40.004805 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d9d6f-8762-4d48-96b6-28b31c8e90b9 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:40.016034 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 802/1596] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:31:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:31:41.941327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19d057-71b7-4041-aa86-ae9b4eaa9d5b None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:41.941796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19d057-71b7-4041-aa86-ae9b4eaa9d5b None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:41.941796 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19d057-71b7-4041-aa86-ae9b4eaa9d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:41.960984 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-df19d057-71b7-4041-aa86-ae9b4eaa9d5b None None] MFA Rules not processed for user `7c398cf6318240f09d2c3b62bc6761d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:41.962220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-df19d057-71b7-4041-aa86-ae9b4eaa9d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:41.969364 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 795/1597] 10.222.0.25 () {58 vars in 1009 bytes} [Sat Sep 24 19:31:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:31:41.982136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d9d6f-8762-4d48-96b6-28b31c8e90b9 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:41.993764 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d9d6f-8762-4d48-96b6-28b31c8e90b9 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:41.998879 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cac9b-722e-48c0-905c-975b58dc6fbf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85b45de73f7b4f7da7e0e8d8375deb37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:41.999478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cac9b-722e-48c0-905c-975b58dc6fbf service swift] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:41.999755 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cac9b-722e-48c0-905c-975b58dc6fbf service swift] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:42.000025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cac9b-722e-48c0-905c-975b58dc6fbf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:42.008674 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cac9b-722e-48c0-905c-975b58dc6fbf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:42.010245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cac9b-722e-48c0-905c-975b58dc6fbf service swift] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:42.019444 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 803/1598] 10.222.0.25 () {60 vars in 1384 bytes} [Sat Sep 24 19:31:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 19:31:51.955584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=64 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:31:52.015517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=54 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:31:57.168315 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50bb8e-79ad-4c7c-90c2-8e0bc6ceff7f None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:57.168808 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50bb8e-79ad-4c7c-90c2-8e0bc6ceff7f None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:57.168901 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50bb8e-79ad-4c7c-90c2-8e0bc6ceff7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:57.189210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-df50bb8e-79ad-4c7c-90c2-8e0bc6ceff7f None None] MFA Rules not processed for user `1763ed41f99a4778b3df6eebcc6d94e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:57.190483 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-df50bb8e-79ad-4c7c-90c2-8e0bc6ceff7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:57.197261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 796/1599] 10.222.0.48 () {58 vars in 1015 bytes} [Sat Sep 24 19:31:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:31:57.212287 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cac9b-722e-48c0-905c-975b58dc6fbf service swift] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:57.221242 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cac9b-722e-48c0-905c-975b58dc6fbf service swift] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:57.225644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58488748-ad89-4830-916b-44ab697cb241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:57.226236 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58488748-ad89-4830-916b-44ab697cb241 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:57.226988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58488748-ad89-4830-916b-44ab697cb241 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:57.226988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58488748-ad89-4830-916b-44ab697cb241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:57.234039 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58488748-ad89-4830-916b-44ab697cb241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:57.235560 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58488748-ad89-4830-916b-44ab697cb241 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:57.244284 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 804/1600] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:31:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:31:58.142073 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8734d71-5ab6-41d7-8592-e16fc2fde928 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:58.142391 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8734d71-5ab6-41d7-8592-e16fc2fde928 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:58.142644 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8734d71-5ab6-41d7-8592-e16fc2fde928 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:58.144305 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 797/1601] 10.222.0.25 () {54 vars in 921 bytes} [Sat Sep 24 19:31:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:31:58.164974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c43e5-6d31-47d3-b6cc-e27702ff157f None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:58.165920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c43e5-6d31-47d3-b6cc-e27702ff157f None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:58.166202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c43e5-6d31-47d3-b6cc-e27702ff157f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:58.189121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-c64c43e5-6d31-47d3-b6cc-e27702ff157f None None] MFA Rules not processed for user `4e5798be0fa544cf9cf48558e87fcfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:58.190375 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-c64c43e5-6d31-47d3-b6cc-e27702ff157f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:58.202737 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 805/1602] 10.222.0.25 () {58 vars in 1018 bytes} [Sat Sep 24 19:31:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:31:58.254278 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8734d71-5ab6-41d7-8592-e16fc2fde928 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:58.273464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8734d71-5ab6-41d7-8592-e16fc2fde928 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:58.280995 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c105e-6207-4ebe-949d-1bddb93242f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:58.282023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c105e-6207-4ebe-949d-1bddb93242f3 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:58.282023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c105e-6207-4ebe-949d-1bddb93242f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:58.282204 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c105e-6207-4ebe-949d-1bddb93242f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:58.300937 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c105e-6207-4ebe-949d-1bddb93242f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:58.303127 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c105e-6207-4ebe-949d-1bddb93242f3 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:58.314216 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 798/1603] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:31:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:32:06.524495 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90994e03-ce38-4548-8f7e-efa1dd018e1a None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:06.525097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90994e03-ce38-4548-8f7e-efa1dd018e1a None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:06.525097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90994e03-ce38-4548-8f7e-efa1dd018e1a None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:06.526421 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 806/1604] 10.222.0.25 () {54 vars in 921 bytes} [Sat Sep 24 19:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:32:06.535770 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794064b7-d957-40cf-89df-a971d4affe57 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:06.536240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794064b7-d957-40cf-89df-a971d4affe57 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:06.536566 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794064b7-d957-40cf-89df-a971d4affe57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:06.557019 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-794064b7-d957-40cf-89df-a971d4affe57 None None] MFA Rules not processed for user `4e5798be0fa544cf9cf48558e87fcfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:32:06.558229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-794064b7-d957-40cf-89df-a971d4affe57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:32:06.568244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 799/1605] 10.222.0.25 () {58 vars in 1018 bytes} [Sat Sep 24 19:32:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:32:06.584960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90994e03-ce38-4548-8f7e-efa1dd018e1a None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:32:06.599399 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90994e03-ce38-4548-8f7e-efa1dd018e1a None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:32:06.604800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de64ea3-34b6-4e60-a4c1-3e1d9e4316f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:32:06.605403 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de64ea3-34b6-4e60-a4c1-3e1d9e4316f4 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:06.605680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de64ea3-34b6-4e60-a4c1-3e1d9e4316f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:06.605947 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de64ea3-34b6-4e60-a4c1-3e1d9e4316f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:06.615240 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de64ea3-34b6-4e60-a4c1-3e1d9e4316f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:32:06.616801 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de64ea3-34b6-4e60-a4c1-3e1d9e4316f4 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:32:06.626765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 807/1606] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:32:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:32:16.551179 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=12 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:32:16.622629 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=15 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:32:25.914465 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e37eb-59ab-469c-bec1-7d5242524310 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:25.914983 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e37eb-59ab-469c-bec1-7d5242524310 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:25.915086 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e37eb-59ab-469c-bec1-7d5242524310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:25.934140 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-af5e37eb-59ab-469c-bec1-7d5242524310 None None] MFA Rules not processed for user `ea311a3ffec74f2285505b177504a75b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:32:25.935382 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-af5e37eb-59ab-469c-bec1-7d5242524310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:32:25.942251 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 800/1607] 10.222.0.25 () {58 vars in 958 bytes} [Sat Sep 24 19:32:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:32:26.256811 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f586f37-d418-400a-b103-c99051c7cbd3 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:26.257327 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f586f37-d418-400a-b103-c99051c7cbd3 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:26.257434 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f586f37-d418-400a-b103-c99051c7cbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:26.278157 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-7f586f37-d418-400a-b103-c99051c7cbd3 None None] MFA Rules not processed for user `1763ed41f99a4778b3df6eebcc6d94e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:32:26.279537 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-7f586f37-d418-400a-b103-c99051c7cbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:32:26.287116 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 808/1608] 10.222.0.25 () {58 vars in 1009 bytes} [Sat Sep 24 19:32:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:32:26.298940 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e37eb-59ab-469c-bec1-7d5242524310 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:32:26.308587 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e37eb-59ab-469c-bec1-7d5242524310 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:32:26.312141 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e09f97-b8cc-47be-b8ad-6d5af37e7b9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:32:26.312744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e09f97-b8cc-47be-b8ad-6d5af37e7b9e service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:26.313018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e09f97-b8cc-47be-b8ad-6d5af37e7b9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:26.313289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e09f97-b8cc-47be-b8ad-6d5af37e7b9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:26.321922 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e09f97-b8cc-47be-b8ad-6d5af37e7b9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:32:26.323399 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e09f97-b8cc-47be-b8ad-6d5af37e7b9e service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:32:26.338351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 801/1609] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:32:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:32:34.369819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f586f37-d418-400a-b103-c99051c7cbd3 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:32:34.379046 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f586f37-d418-400a-b103-c99051c7cbd3 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:32:34.383411 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e788b6-5158-4001-88c9-944140bc4443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:32:34.384027 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e788b6-5158-4001-88c9-944140bc4443 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:34.384307 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e788b6-5158-4001-88c9-944140bc4443 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:34.384577 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e788b6-5158-4001-88c9-944140bc4443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:34.393849 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e788b6-5158-4001-88c9-944140bc4443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:32:34.395412 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e788b6-5158-4001-88c9-944140bc4443 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:32:34.405136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 809/1610] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:32:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:32:34.513131 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e2a60-24f9-4999-9859-b1dcd67157bf None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:34.513741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e2a60-24f9-4999-9859-b1dcd67157bf None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:34.513741 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e2a60-24f9-4999-9859-b1dcd67157bf None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:34.515563 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 802/1611] 10.222.0.25 () {54 vars in 921 bytes} [Sat Sep 24 19:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:32:34.542096 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52581c1-7345-42aa-8329-e7c7bc48528e None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:34.543209 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52581c1-7345-42aa-8329-e7c7bc48528e None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:34.543560 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52581c1-7345-42aa-8329-e7c7bc48528e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:34.564718 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-f52581c1-7345-42aa-8329-e7c7bc48528e None None] MFA Rules not processed for user `4e5798be0fa544cf9cf48558e87fcfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:32:34.566053 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-f52581c1-7345-42aa-8329-e7c7bc48528e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:32:34.577159 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 810/1612] 10.222.0.25 () {58 vars in 1018 bytes} [Sat Sep 24 19:32:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:32:34.604313 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e2a60-24f9-4999-9859-b1dcd67157bf None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:32:34.642496 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e2a60-24f9-4999-9859-b1dcd67157bf None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:32:34.651576 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8d61f-d096-4a06-a3e0-0dd60a0ed750 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:32:34.652526 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8d61f-d096-4a06-a3e0-0dd60a0ed750 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:34.653008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8d61f-d096-4a06-a3e0-0dd60a0ed750 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:34.653494 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8d61f-d096-4a06-a3e0-0dd60a0ed750 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:34.666784 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8d61f-d096-4a06-a3e0-0dd60a0ed750 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:32:34.668694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8d61f-d096-4a06-a3e0-0dd60a0ed750 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:32:34.680614 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 803/1613] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:32:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:32:44.558664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=12 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:32:44.675678 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=15 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:33:25.419194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0551fbd-8206-49f7-8487-5cc825274481 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:25.419194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0551fbd-8206-49f7-8487-5cc825274481 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:25.419194 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0551fbd-8206-49f7-8487-5cc825274481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:25.438512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-b0551fbd-8206-49f7-8487-5cc825274481 None None] MFA Rules not processed for user `ea311a3ffec74f2285505b177504a75b`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:33:25.439662 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-b0551fbd-8206-49f7-8487-5cc825274481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:33:25.447225 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 811/1614] 10.222.0.25 () {58 vars in 958 bytes} [Sat Sep 24 19:33:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:33:35.433698 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:33:44.622971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8500800-743b-4cb7-884c-f591091a0c4a None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:44.623506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8500800-743b-4cb7-884c-f591091a0c4a None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:44.623506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8500800-743b-4cb7-884c-f591091a0c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:44.642059 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-b8500800-743b-4cb7-884c-f591091a0c4a None None] MFA Rules not processed for user `7c398cf6318240f09d2c3b62bc6761d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:33:44.643271 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b8500800-743b-4cb7-884c-f591091a0c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:33:44.651000 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 804/1615] 10.222.0.25 () {58 vars in 1009 bytes} [Sat Sep 24 19:33:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:33:44.692547 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0551fbd-8206-49f7-8487-5cc825274481 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:44.704659 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0551fbd-8206-49f7-8487-5cc825274481 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:44.709620 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433edc86-bc75-4eb2-b84c-df39ebefd03f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85b45de73f7b4f7da7e0e8d8375deb37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:44.710754 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433edc86-bc75-4eb2-b84c-df39ebefd03f service swift] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:44.711212 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433edc86-bc75-4eb2-b84c-df39ebefd03f service swift] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:44.711469 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433edc86-bc75-4eb2-b84c-df39ebefd03f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:44.719381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433edc86-bc75-4eb2-b84c-df39ebefd03f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:44.720994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433edc86-bc75-4eb2-b84c-df39ebefd03f service swift] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:44.729413 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 812/1616] 10.222.0.25 () {60 vars in 1384 bytes} [Sat Sep 24 19:33:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 19:33:50.108774 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486a8cb-f0da-4881-80c0-6152349641a3 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:50.109233 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486a8cb-f0da-4881-80c0-6152349641a3 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:50.109336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486a8cb-f0da-4881-80c0-6152349641a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:50.128646 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-7486a8cb-f0da-4881-80c0-6152349641a3 None None] MFA Rules not processed for user `ea311a3ffec74f2285505b177504a75b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:33:50.129824 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-7486a8cb-f0da-4881-80c0-6152349641a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:33:50.138595 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 805/1617] 10.222.0.25 () {58 vars in 958 bytes} [Sat Sep 24 19:33:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:33:54.726399 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=6 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:34:00.123414 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=6 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:34:23.483324 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001fcee-2590-4576-a27d-cfa05aadeb49 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:23.483837 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001fcee-2590-4576-a27d-cfa05aadeb49 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:23.483960 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001fcee-2590-4576-a27d-cfa05aadeb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:23.504142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-2001fcee-2590-4576-a27d-cfa05aadeb49 None None] MFA Rules not processed for user `7c398cf6318240f09d2c3b62bc6761d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:34:23.505557 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2001fcee-2590-4576-a27d-cfa05aadeb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:34:23.513082 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 813/1618] 10.222.0.25 () {58 vars in 967 bytes} [Sat Sep 24 19:34:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:34:23.526428 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486a8cb-f0da-4881-80c0-6152349641a3 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:34:23.539981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486a8cb-f0da-4881-80c0-6152349641a3 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:34:23.545067 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2987c-6707-444d-946d-94c2befaeb15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85b45de73f7b4f7da7e0e8d8375deb37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:34:23.545798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2987c-6707-444d-946d-94c2befaeb15 service swift] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:23.546692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2987c-6707-444d-946d-94c2befaeb15 service swift] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:23.547133 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2987c-6707-444d-946d-94c2befaeb15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:23.556107 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2987c-6707-444d-946d-94c2befaeb15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:34:23.557692 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2987c-6707-444d-946d-94c2befaeb15 service swift] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:34:23.565830 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 806/1619] 10.222.0.25 () {60 vars in 1384 bytes} [Sat Sep 24 19:34:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 19:34:33.499230 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=3 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:34:33.562480 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=6 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:34:48.578697 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c330721-e733-4bee-9fed-3295a9676e27 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:48.579252 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c330721-e733-4bee-9fed-3295a9676e27 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:48.579422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c330721-e733-4bee-9fed-3295a9676e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:48.600173 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-4c330721-e733-4bee-9fed-3295a9676e27 None None] MFA Rules not processed for user `ea311a3ffec74f2285505b177504a75b`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:34:48.601350 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-4c330721-e733-4bee-9fed-3295a9676e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:34:48.607998 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 814/1620] 10.222.0.25 () {58 vars in 958 bytes} [Sat Sep 24 19:34:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:34:49.827294 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0682f-6b9a-4684-865d-9f9354c78952 None None] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:49.827789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0682f-6b9a-4684-865d-9f9354c78952 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:49.827885 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0682f-6b9a-4684-865d-9f9354c78952 None None] PATH_INFO: `/` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:49.829201 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 807/1621] 10.222.0.25 () {54 vars in 961 bytes} [Sat Sep 24 19:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:34:49.834633 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fbeb5-e022-4960-9c54-bfca8d7967da None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:49.835108 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fbeb5-e022-4960-9c54-bfca8d7967da None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:49.835235 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fbeb5-e022-4960-9c54-bfca8d7967da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:49.854586 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-d74fbeb5-e022-4960-9c54-bfca8d7967da None None] MFA Rules not processed for user `95a375bda898420fb9df08d514bf9bff`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:34:49.855797 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-d74fbeb5-e022-4960-9c54-bfca8d7967da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:34:49.864041 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 815/1622] 10.222.0.25 () {58 vars in 1058 bytes} [Sat Sep 24 19:34:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:34:49.872166 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0682f-6b9a-4684-865d-9f9354c78952 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:34:49.886123 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0682f-6b9a-4684-865d-9f9354c78952 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:34:49.891080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e02f6-b497-4ed4-a05b-8cbce76304be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a375bda898420fb9df08d514bf9bff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:34:49.891675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e02f6-b497-4ed4-a05b-8cbce76304be service placement] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:49.891956 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e02f6-b497-4ed4-a05b-8cbce76304be service placement] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:49.892228 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e02f6-b497-4ed4-a05b-8cbce76304be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:49.900456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e02f6-b497-4ed4-a05b-8cbce76304be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:34:49.902016 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e02f6-b497-4ed4-a05b-8cbce76304be service placement] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:34:49.911886 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 808/1623] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:34:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:34:59.849782 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=6 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:34:59.907845 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=6 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:35:06.072646 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fbeb5-e022-4960-9c54-bfca8d7967da None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:35:06.081648 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fbeb5-e022-4960-9c54-bfca8d7967da None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:35:06.085977 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290e42e-e1ef-4ab0-bcc0-0a984dcd4611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:35:06.086613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290e42e-e1ef-4ab0-bcc0-0a984dcd4611 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:35:06.086928 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290e42e-e1ef-4ab0-bcc0-0a984dcd4611 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:35:06.087202 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290e42e-e1ef-4ab0-bcc0-0a984dcd4611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:35:06.096100 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290e42e-e1ef-4ab0-bcc0-0a984dcd4611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:35:06.097511 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290e42e-e1ef-4ab0-bcc0-0a984dcd4611 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:35:06.107403 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 816/1624] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:35:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:35:16.103301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=6 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:36:59.506842 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e02f6-b497-4ed4-a05b-8cbce76304be service placement] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:36:59.519351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e02f6-b497-4ed4-a05b-8cbce76304be service placement] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:36:59.525660 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42b95b-73c0-49a1-b6f2-89a96b95b38b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:36:59.526295 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42b95b-73c0-49a1-b6f2-89a96b95b38b service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:36:59.526675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42b95b-73c0-49a1-b6f2-89a96b95b38b service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:36:59.527036 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42b95b-73c0-49a1-b6f2-89a96b95b38b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:36:59.534996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42b95b-73c0-49a1-b6f2-89a96b95b38b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:36:59.536555 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42b95b-73c0-49a1-b6f2-89a96b95b38b service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:36:59.545772 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 809/1625] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:36:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:36:59.593985 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290e42e-e1ef-4ab0-bcc0-0a984dcd4611 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:36:59.602521 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290e42e-e1ef-4ab0-bcc0-0a984dcd4611 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:36:59.606137 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57998e-7c9b-4fb7-b7c7-d5bee4539019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:36:59.606723 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57998e-7c9b-4fb7-b7c7-d5bee4539019 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:36:59.607028 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57998e-7c9b-4fb7-b7c7-d5bee4539019 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:36:59.607300 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57998e-7c9b-4fb7-b7c7-d5bee4539019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:36:59.617136 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57998e-7c9b-4fb7-b7c7-d5bee4539019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:36:59.618546 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57998e-7c9b-4fb7-b7c7-d5bee4539019 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:36:59.629023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 817/1626] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:36:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:37:00.169244 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42b95b-73c0-49a1-b6f2-89a96b95b38b service nova] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:00.178405 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42b95b-73c0-49a1-b6f2-89a96b95b38b service nova] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:00.183080 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe879cf-7de1-4bc7-b781-78b35cf9381a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:00.184127 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe879cf-7de1-4bc7-b781-78b35cf9381a service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:00.184127 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe879cf-7de1-4bc7-b781-78b35cf9381a service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:00.184329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe879cf-7de1-4bc7-b781-78b35cf9381a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:00.193019 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe879cf-7de1-4bc7-b781-78b35cf9381a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:00.194487 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe879cf-7de1-4bc7-b781-78b35cf9381a service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:00.204431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 810/1627] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:37:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:37:04.243051 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57998e-7c9b-4fb7-b7c7-d5bee4539019 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:04.296571 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57998e-7c9b-4fb7-b7c7-d5bee4539019 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:04.300138 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13b808-1ad2-44d3-a56c-3b4a12a4d784 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5840a13ddf8c45f2bf97a4f6d4a48d96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:04.300735 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13b808-1ad2-44d3-a56c-3b4a12a4d784 service cinder] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:04.300996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13b808-1ad2-44d3-a56c-3b4a12a4d784 service cinder] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:04.301265 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13b808-1ad2-44d3-a56c-3b4a12a4d784 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:04.315456 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13b808-1ad2-44d3-a56c-3b4a12a4d784 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:04.316877 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13b808-1ad2-44d3-a56c-3b4a12a4d784 service cinder] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:04.328008 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 818/1628] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:37:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:37:09.221848 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c5cdc-957c-4e07-8c65-9d616b9ce435 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:09.222289 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c5cdc-957c-4e07-8c65-9d616b9ce435 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:09.222381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c5cdc-957c-4e07-8c65-9d616b9ce435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:09.242025 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-578c5cdc-957c-4e07-8c65-9d616b9ce435 None None] MFA Rules not processed for user `7c398cf6318240f09d2c3b62bc6761d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:09.243309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-578c5cdc-957c-4e07-8c65-9d616b9ce435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:09.250744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 811/1629] 10.222.0.25 () {58 vars in 967 bytes} [Sat Sep 24 19:37:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:37:09.299650 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13b808-1ad2-44d3-a56c-3b4a12a4d784 service cinder] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:09.311065 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13b808-1ad2-44d3-a56c-3b4a12a4d784 service cinder] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:09.315953 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad02432-a1d3-4aa2-8a67-952a3be5e2f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85b45de73f7b4f7da7e0e8d8375deb37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:09.316537 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad02432-a1d3-4aa2-8a67-952a3be5e2f9 service swift] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:09.316811 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad02432-a1d3-4aa2-8a67-952a3be5e2f9 service swift] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:09.317075 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad02432-a1d3-4aa2-8a67-952a3be5e2f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:09.325864 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad02432-a1d3-4aa2-8a67-952a3be5e2f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:09.327507 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad02432-a1d3-4aa2-8a67-952a3be5e2f9 service swift] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:09.336261 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 819/1630] 10.222.0.25 () {60 vars in 1384 bytes} [Sat Sep 24 19:37:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 19:37:09.821120 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08aa8e-8ad8-47e4-93e1-2f5bf3bf3522 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:09.821436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08aa8e-8ad8-47e4-93e1-2f5bf3bf3522 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:09.821712 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08aa8e-8ad8-47e4-93e1-2f5bf3bf3522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:09.842868 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-4b08aa8e-8ad8-47e4-93e1-2f5bf3bf3522 None None] MFA Rules not processed for user `7c398cf6318240f09d2c3b62bc6761d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:09.844390 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4b08aa8e-8ad8-47e4-93e1-2f5bf3bf3522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:09.851736 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 812/1631] 10.222.0.25 () {58 vars in 1009 bytes} [Sat Sep 24 19:37:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:37:09.863861 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad02432-a1d3-4aa2-8a67-952a3be5e2f9 service swift] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:09.874995 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad02432-a1d3-4aa2-8a67-952a3be5e2f9 service swift] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:09.879994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ab11f-9599-4ba7-be47-aeb79108b2a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85b45de73f7b4f7da7e0e8d8375deb37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:09.880579 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ab11f-9599-4ba7-be47-aeb79108b2a8 service swift] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:09.880857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ab11f-9599-4ba7-be47-aeb79108b2a8 service swift] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:09.881130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ab11f-9599-4ba7-be47-aeb79108b2a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:09.896681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ab11f-9599-4ba7-be47-aeb79108b2a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:09.898684 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ab11f-9599-4ba7-be47-aeb79108b2a8 service swift] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:09.906669 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 820/1632] 10.222.0.25 () {60 vars in 1384 bytes} [Sat Sep 24 19:37:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 19:37:18.472835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68972bf9-f3fd-451f-85e6-813fcb0e1280 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:18.473331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68972bf9-f3fd-451f-85e6-813fcb0e1280 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:18.473450 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68972bf9-f3fd-451f-85e6-813fcb0e1280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:18.494654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-68972bf9-f3fd-451f-85e6-813fcb0e1280 None None] MFA Rules not processed for user `a55ca211737b42938212daed08bb05d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:18.495889 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-68972bf9-f3fd-451f-85e6-813fcb0e1280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:18.502675 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 813/1633] 10.222.0.25 () {58 vars in 958 bytes} [Sat Sep 24 19:37:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:37:18.765756 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ab11f-9599-4ba7-be47-aeb79108b2a8 service swift] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:18.775482 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ab11f-9599-4ba7-be47-aeb79108b2a8 service swift] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:18.779076 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fb0af-b961-4c0d-af93-1c5cc9bdf3a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:18.779666 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fb0af-b961-4c0d-af93-1c5cc9bdf3a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:18.779941 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fb0af-b961-4c0d-af93-1c5cc9bdf3a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:18.780212 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fb0af-b961-4c0d-af93-1c5cc9bdf3a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:18.787435 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fb0af-b961-4c0d-af93-1c5cc9bdf3a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:18.789512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fb0af-b961-4c0d-af93-1c5cc9bdf3a1 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:18.797068 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 821/1634] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:37:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:37:19.112789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68972bf9-f3fd-451f-85e6-813fcb0e1280 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:19.125134 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68972bf9-f3fd-451f-85e6-813fcb0e1280 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:19.130300 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e6dd4-0acd-4284-bcd1-26b62e10aa50 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a375bda898420fb9df08d514bf9bff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:19.131032 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e6dd4-0acd-4284-bcd1-26b62e10aa50 service placement] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:19.131306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e6dd4-0acd-4284-bcd1-26b62e10aa50 service placement] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:19.132180 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e6dd4-0acd-4284-bcd1-26b62e10aa50 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:19.141589 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e6dd4-0acd-4284-bcd1-26b62e10aa50 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:19.143905 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e6dd4-0acd-4284-bcd1-26b62e10aa50 service placement] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:19.155445 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 814/1635] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:37:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:37:20.528119 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac53993-1020-46f4-8759-cd018ae1ddf5 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:20.528653 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac53993-1020-46f4-8759-cd018ae1ddf5 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:20.528740 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac53993-1020-46f4-8759-cd018ae1ddf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:20.551003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-9ac53993-1020-46f4-8759-cd018ae1ddf5 None None] MFA Rules not processed for user `7c398cf6318240f09d2c3b62bc6761d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:20.552247 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-9ac53993-1020-46f4-8759-cd018ae1ddf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:20.559705 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 822/1636] 10.222.0.25 () {58 vars in 1009 bytes} [Sat Sep 24 19:37:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:37:20.574158 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e6dd4-0acd-4284-bcd1-26b62e10aa50 service placement] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:20.579969 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=28 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:20.588069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e6dd4-0acd-4284-bcd1-26b62e10aa50 service placement] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:20.593246 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242384d-6782-4c5c-bda8-04d4bdf06cdc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85b45de73f7b4f7da7e0e8d8375deb37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:20.593871 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242384d-6782-4c5c-bda8-04d4bdf06cdc service swift] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:20.594153 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242384d-6782-4c5c-bda8-04d4bdf06cdc service swift] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:20.594424 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242384d-6782-4c5c-bda8-04d4bdf06cdc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:20.603559 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242384d-6782-4c5c-bda8-04d4bdf06cdc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:20.605171 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242384d-6782-4c5c-bda8-04d4bdf06cdc service swift] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:20.620936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 815/1637] 10.222.0.25 () {60 vars in 1384 bytes} [Sat Sep 24 19:37:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 19:37:30.545466 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=53 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:30.610459 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=5 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:32.239251 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac53993-1020-46f4-8759-cd018ae1ddf5 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:32.252316 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac53993-1020-46f4-8759-cd018ae1ddf5 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:32.257827 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab8ddf-a665-4fc2-817d-85d010674d23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:32.258443 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab8ddf-a665-4fc2-817d-85d010674d23 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:32.258720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab8ddf-a665-4fc2-817d-85d010674d23 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:32.259036 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab8ddf-a665-4fc2-817d-85d010674d23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:32.266987 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab8ddf-a665-4fc2-817d-85d010674d23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:32.268555 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab8ddf-a665-4fc2-817d-85d010674d23 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:32.278209 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 823/1638] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:37:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:37:35.891122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242384d-6782-4c5c-bda8-04d4bdf06cdc service swift] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:35.903671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242384d-6782-4c5c-bda8-04d4bdf06cdc service swift] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:35.909436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9cc8f-0b0b-4067-9d7d-7c3eaa420c83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:35.910040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9cc8f-0b0b-4067-9d7d-7c3eaa420c83 service nova] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:35.910323 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9cc8f-0b0b-4067-9d7d-7c3eaa420c83 service nova] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:35.910595 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9cc8f-0b0b-4067-9d7d-7c3eaa420c83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:35.920072 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9cc8f-0b0b-4067-9d7d-7c3eaa420c83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:35.921776 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9cc8f-0b0b-4067-9d7d-7c3eaa420c83 service nova] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:35.933478 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 816/1639] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:37:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:37:39.442003 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb02e8e-aeae-4bdb-ab59-4d769c085d82 None None] REQUEST_METHOD: `POST` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:39.442461 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb02e8e-aeae-4bdb-ab59-4d769c085d82 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:39.442551 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb02e8e-aeae-4bdb-ab59-4d769c085d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:39.461430 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.auth.core [None req-cbb02e8e-aeae-4bdb-ab59-4d769c085d82 None None] MFA Rules not processed for user `ea311a3ffec74f2285505b177504a75b`. Rule list: `[]` (Enabled: `True`). {{(pid=81420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:37:39.462654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-cbb02e8e-aeae-4bdb-ab59-4d769c085d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:37:39.469488 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 824/1640] 10.222.0.25 () {58 vars in 958 bytes} [Sat Sep 24 19:37:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:37:39.780520 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9cc8f-0b0b-4067-9d7d-7c3eaa420c83 service nova] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:39.790720 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9cc8f-0b0b-4067-9d7d-7c3eaa420c83 service nova] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:39.794273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a72471-94a4-452c-bf80-e135c446baf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:39.794891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a72471-94a4-452c-bf80-e135c446baf8 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:39.795172 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a72471-94a4-452c-bf80-e135c446baf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:39.795442 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a72471-94a4-452c-bf80-e135c446baf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:39.802208 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a72471-94a4-452c-bf80-e135c446baf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:39.803821 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a72471-94a4-452c-bf80-e135c446baf8 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:39.811368 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 817/1641] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:37:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:37:40.374598 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb02e8e-aeae-4bdb-ab59-4d769c085d82 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:40.389536 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb02e8e-aeae-4bdb-ab59-4d769c085d82 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:40.395982 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e2b59-48a8-4d91-8405-85d5f8d78e80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:40.397232 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e2b59-48a8-4d91-8405-85d5f8d78e80 service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:40.397584 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e2b59-48a8-4d91-8405-85d5f8d78e80 service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:40.397866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e2b59-48a8-4d91-8405-85d5f8d78e80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:40.407146 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e2b59-48a8-4d91-8405-85d5f8d78e80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:40.408997 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e2b59-48a8-4d91-8405-85d5f8d78e80 service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:40.421664 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 825/1642] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:37:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:37:49.808054 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=12 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:50.416300 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=15 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:53.467272 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a72471-94a4-452c-bf80-e135c446baf8 service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:53.476163 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a72471-94a4-452c-bf80-e135c446baf8 service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:53.479787 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fe7f4-95a5-4465-8963-caf15e2758d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:53.480383 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fe7f4-95a5-4465-8963-caf15e2758d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:53.480657 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fe7f4-95a5-4465-8963-caf15e2758d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:53.480928 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fe7f4-95a5-4465-8963-caf15e2758d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:53.489615 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fe7f4-95a5-4465-8963-caf15e2758d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:53.491102 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fe7f4-95a5-4465-8963-caf15e2758d1 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:53.500219 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 818/1643] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:37:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:37:56.826765 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e2b59-48a8-4d91-8405-85d5f8d78e80 service nova] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:56.843023 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e2b59-48a8-4d91-8405-85d5f8d78e80 service nova] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:56.852866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468b4d1-c1b8-4d8d-853f-ac56059feb4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:56.853530 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468b4d1-c1b8-4d8d-853f-ac56059feb4d service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:56.853974 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468b4d1-c1b8-4d8d-853f-ac56059feb4d service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:56.854382 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468b4d1-c1b8-4d8d-853f-ac56059feb4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:56.864770 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468b4d1-c1b8-4d8d-853f-ac56059feb4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:56.867348 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468b4d1-c1b8-4d8d-853f-ac56059feb4d service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:56.880671 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 826/1644] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:37:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:38:03.496109 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=6 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:06.874628 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=6 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:11.311131 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b7205-9c78-4c71-af5a-014c9fd0b3a5 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:11.312282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b7205-9c78-4c71-af5a-014c9fd0b3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:11.312282 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b7205-9c78-4c71-af5a-014c9fd0b3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:11.340062 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-328b7205-9c78-4c71-af5a-014c9fd0b3a5 None None] MFA Rules not processed for user `ea311a3ffec74f2285505b177504a75b`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:40:11.341257 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-328b7205-9c78-4c71-af5a-014c9fd0b3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:11.364529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 819/1645] 10.222.0.25 () {58 vars in 958 bytes} [Sat Sep 24 19:40:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:40:13.606555 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468b4d1-c1b8-4d8d-853f-ac56059feb4d service nova] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:13.608508 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2468b4d1-c1b8-4d8d-853f-ac56059feb4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:13.687235 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468b4d1-c1b8-4d8d-853f-ac56059feb4d service nova] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:13.692414 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483febfb-fc13-4b7e-9f38-8d5dbcef3a81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a375bda898420fb9df08d514bf9bff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:13.693018 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483febfb-fc13-4b7e-9f38-8d5dbcef3a81 service placement] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:13.693296 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483febfb-fc13-4b7e-9f38-8d5dbcef3a81 service placement] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:13.693568 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483febfb-fc13-4b7e-9f38-8d5dbcef3a81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:13.695446 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-483febfb-fc13-4b7e-9f38-8d5dbcef3a81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:13.707338 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483febfb-fc13-4b7e-9f38-8d5dbcef3a81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:13.708739 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483febfb-fc13-4b7e-9f38-8d5dbcef3a81 service placement] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:13.719725 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 827/1646] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:40:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:40:21.362797 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=15 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:23.354630 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf159a8-90f1-4192-a36d-e61fea56fea2 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:23.355195 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf159a8-90f1-4192-a36d-e61fea56fea2 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:23.355195 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf159a8-90f1-4192-a36d-e61fea56fea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:23.385172 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-8cf159a8-90f1-4192-a36d-e61fea56fea2 None None] MFA Rules not processed for user `7c398cf6318240f09d2c3b62bc6761d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:40:23.386367 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-8cf159a8-90f1-4192-a36d-e61fea56fea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:23.399981 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 820/1647] 10.222.0.25 () {58 vars in 967 bytes} [Sat Sep 24 19:40:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:40:23.443224 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483febfb-fc13-4b7e-9f38-8d5dbcef3a81 service placement] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:23.454754 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483febfb-fc13-4b7e-9f38-8d5dbcef3a81 service placement] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:23.459742 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4f368-ff7c-4219-9f63-184195ca80a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85b45de73f7b4f7da7e0e8d8375deb37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:23.460335 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4f368-ff7c-4219-9f63-184195ca80a4 service swift] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:23.460612 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4f368-ff7c-4219-9f63-184195ca80a4 service swift] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:23.460884 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4f368-ff7c-4219-9f63-184195ca80a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:23.469477 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4f368-ff7c-4219-9f63-184195ca80a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:23.471180 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4f368-ff7c-4219-9f63-184195ca80a4 service swift] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:23.479531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 828/1648] 10.222.0.25 () {60 vars in 1384 bytes} [Sat Sep 24 19:40:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 19:40:23.833374 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf159a8-90f1-4192-a36d-e61fea56fea2 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:23.853130 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf159a8-90f1-4192-a36d-e61fea56fea2 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:23.857043 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823588a7-87e4-4e2f-99c3-27a5b2ce8fa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:23.857653 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823588a7-87e4-4e2f-99c3-27a5b2ce8fa4 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:23.857933 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823588a7-87e4-4e2f-99c3-27a5b2ce8fa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:23.858809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823588a7-87e4-4e2f-99c3-27a5b2ce8fa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:23.934663 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823588a7-87e4-4e2f-99c3-27a5b2ce8fa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:23.936184 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823588a7-87e4-4e2f-99c3-27a5b2ce8fa4 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:23.955273 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 821/1649] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:40:27.390014 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c67b8-7cd4-4c60-8c45-7d2a4ffd2fb0 None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:27.390600 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c67b8-7cd4-4c60-8c45-7d2a4ffd2fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:27.390972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c67b8-7cd4-4c60-8c45-7d2a4ffd2fb0 None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:27.392942 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 829/1650] 10.222.0.25 () {54 vars in 921 bytes} [Sat Sep 24 19:40:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:40:27.421814 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66ec6e-b82a-4748-a910-9753972ca621 None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:27.422377 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66ec6e-b82a-4748-a910-9753972ca621 None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:27.423486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66ec6e-b82a-4748-a910-9753972ca621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:27.520808 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-ab66ec6e-b82a-4748-a910-9753972ca621 None None] MFA Rules not processed for user `95a375bda898420fb9df08d514bf9bff`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:40:27.522363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-ab66ec6e-b82a-4748-a910-9753972ca621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:27.532988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 822/1651] 10.222.0.25 () {58 vars in 1018 bytes} [Sat Sep 24 19:40:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:40:27.544350 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c67b8-7cd4-4c60-8c45-7d2a4ffd2fb0 None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:27.560139 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c67b8-7cd4-4c60-8c45-7d2a4ffd2fb0 None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:27.567800 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2fc5c-40c5-42a2-be25-6531b930f18c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a375bda898420fb9df08d514bf9bff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:27.568490 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2fc5c-40c5-42a2-be25-6531b930f18c service placement] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:27.568833 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2fc5c-40c5-42a2-be25-6531b930f18c service placement] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:27.569491 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2fc5c-40c5-42a2-be25-6531b930f18c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:27.578497 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2fc5c-40c5-42a2-be25-6531b930f18c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:27.580421 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2fc5c-40c5-42a2-be25-6531b930f18c service placement] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:27.596371 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 830/1652] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:40:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:40:30.635949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66ec6e-b82a-4748-a910-9753972ca621 None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:30.646803 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66ec6e-b82a-4748-a910-9753972ca621 None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:30.653176 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02e2e6-c81d-47ed-a1db-d2cd66808b40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:30.653799 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02e2e6-c81d-47ed-a1db-d2cd66808b40 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:30.654069 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02e2e6-c81d-47ed-a1db-d2cd66808b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:30.654498 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02e2e6-c81d-47ed-a1db-d2cd66808b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:30.667883 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02e2e6-c81d-47ed-a1db-d2cd66808b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:30.669331 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02e2e6-c81d-47ed-a1db-d2cd66808b40 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:30.687730 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 823/1653] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:40:30 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:40:30.844121 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2fc5c-40c5-42a2-be25-6531b930f18c service placement] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:30.859613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2fc5c-40c5-42a2-be25-6531b930f18c service placement] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:30.864744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d9f30-6778-40aa-a76d-451812852ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:30.865376 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d9f30-6778-40aa-a76d-451812852ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:30.865654 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d9f30-6778-40aa-a76d-451812852ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:30.865923 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d9f30-6778-40aa-a76d-451812852ca1 admin admin] PATH_INFO: `/v3/users/a55ca211737b42938212daed08bb05d6` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:30.867234 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d9f30-6778-40aa-a76d-451812852ca1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a55ca211737b42938212daed08bb05d6)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:30.868381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: WARNING py.warnings [None req-de8d9f30-6778-40aa-a76d-451812852ca1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:40:30.868381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: warnings.warn(msg) Sep 24 19:40:30.868381 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: Sep 24 19:40:30.869775 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d9f30-6778-40aa-a76d-451812852ca1 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:30.950104 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-de8d9f30-6778-40aa-a76d-451812852ca1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a55ca211737b42938212daed08bb05d6'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:30.969732 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-de8d9f30-6778-40aa-a76d-451812852ca1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a55ca211737b42938212daed08bb05d6'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:30.977731 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-de8d9f30-6778-40aa-a76d-451812852ca1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a55ca211737b42938212daed08bb05d6'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:30.978370 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-de8d9f30-6778-40aa-a76d-451812852ca1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a55ca211737b42938212daed08bb05d6'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:30.989328 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-de8d9f30-6778-40aa-a76d-451812852ca1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a55ca211737b42938212daed08bb05d6'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:30.995517 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 831/1654] 10.222.0.25 () {58 vars in 1224 bytes} [Sat Sep 24 19:40:30 2022] DELETE /identity/v3/users/a55ca211737b42938212daed08bb05d6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:40:31.185992 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02e2e6-c81d-47ed-a1db-d2cd66808b40 service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:31.207384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02e2e6-c81d-47ed-a1db-d2cd66808b40 service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:31.281751 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b4569-19c5-4499-8626-175f6eac1b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:31.282489 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b4569-19c5-4499-8626-175f6eac1b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:31.282866 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b4569-19c5-4499-8626-175f6eac1b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:31.283218 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b4569-19c5-4499-8626-175f6eac1b34 admin admin] PATH_INFO: `/v3/projects/9428889910ee424da582b09a939bcf4d` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:31.284750 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b4569-19c5-4499-8626-175f6eac1b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9428889910ee424da582b09a939bcf4d)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:31.285994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: WARNING py.warnings [None req-d51b4569-19c5-4499-8626-175f6eac1b34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:40:31.285994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: warnings.warn(msg) Sep 24 19:40:31.285994 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: Sep 24 19:40:31.287419 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b4569-19c5-4499-8626-175f6eac1b34 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:31.295162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=100 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:31.356534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d51b4569-19c5-4499-8626-175f6eac1b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9428889910ee424da582b09a939bcf4d', 'request_id': 'req-d51b4569-19c5-4499-8626-175f6eac1b34'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:31.372384 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d51b4569-19c5-4499-8626-175f6eac1b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9428889910ee424da582b09a939bcf4d', 'request_id': 'req-d51b4569-19c5-4499-8626-175f6eac1b34'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:31.379102 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d51b4569-19c5-4499-8626-175f6eac1b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9428889910ee424da582b09a939bcf4d', 'request_id': 'req-d51b4569-19c5-4499-8626-175f6eac1b34'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:31.406128 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d51b4569-19c5-4499-8626-175f6eac1b34 admin admin] The token cache is being invalidate because project 9428889910ee424da582b09a939bcf4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:40:31.406420 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d51b4569-19c5-4499-8626-175f6eac1b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:31.407516 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d51b4569-19c5-4499-8626-175f6eac1b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:31.409534 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 824/1655] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Sep 24 19:40:31 2022] DELETE /identity/v3/projects/9428889910ee424da582b09a939bcf4d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:40:31.413544 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d9f30-6778-40aa-a76d-451812852ca1 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:31.415075 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-de8d9f30-6778-40aa-a76d-451812852ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:31.429436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d9f30-6778-40aa-a76d-451812852ca1 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:31.459971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:31.489694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37facd-ce0b-4508-9e12-6535372e328d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:31.490364 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37facd-ce0b-4508-9e12-6535372e328d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:31.490643 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37facd-ce0b-4508-9e12-6535372e328d admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:31.490946 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37facd-ce0b-4508-9e12-6535372e328d admin admin] PATH_INFO: `/v3/users/29ad7bcac88c44fa93ec3e6817e173f2` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:31.492196 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37facd-ce0b-4508-9e12-6535372e328d admin admin] RBAC: Authorizing `identity:delete_user(user_id=29ad7bcac88c44fa93ec3e6817e173f2)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:31.494223 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37facd-ce0b-4508-9e12-6535372e328d admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:31.543661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-5b37facd-ce0b-4508-9e12-6535372e328d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29ad7bcac88c44fa93ec3e6817e173f2'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:31.558643 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-5b37facd-ce0b-4508-9e12-6535372e328d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29ad7bcac88c44fa93ec3e6817e173f2'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:31.568063 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-5b37facd-ce0b-4508-9e12-6535372e328d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29ad7bcac88c44fa93ec3e6817e173f2'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:31.568682 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-5b37facd-ce0b-4508-9e12-6535372e328d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29ad7bcac88c44fa93ec3e6817e173f2'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:31.576529 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-5b37facd-ce0b-4508-9e12-6535372e328d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29ad7bcac88c44fa93ec3e6817e173f2'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:31.583988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 832/1656] 10.222.0.25 () {58 vars in 1224 bytes} [Sat Sep 24 19:40:31 2022] DELETE /identity/v3/users/29ad7bcac88c44fa93ec3e6817e173f2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:40:31.761095 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b4569-19c5-4499-8626-175f6eac1b34 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:31.763156 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d51b4569-19c5-4499-8626-175f6eac1b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:31.788496 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b4569-19c5-4499-8626-175f6eac1b34 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:31.849514 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e58c77-03fa-4b6b-8e10-dbeed8967118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:31.850306 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e58c77-03fa-4b6b-8e10-dbeed8967118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:31.850693 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e58c77-03fa-4b6b-8e10-dbeed8967118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:31.851091 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e58c77-03fa-4b6b-8e10-dbeed8967118 admin admin] PATH_INFO: `/v3/projects/946b7677835e43c69aca9858b9dd7565` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:31.852368 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e58c77-03fa-4b6b-8e10-dbeed8967118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=946b7677835e43c69aca9858b9dd7565)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:31.854339 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e58c77-03fa-4b6b-8e10-dbeed8967118 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:31.903991 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d2e58c77-03fa-4b6b-8e10-dbeed8967118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '946b7677835e43c69aca9858b9dd7565', 'request_id': 'req-d2e58c77-03fa-4b6b-8e10-dbeed8967118'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:31.911048 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d2e58c77-03fa-4b6b-8e10-dbeed8967118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '946b7677835e43c69aca9858b9dd7565', 'request_id': 'req-d2e58c77-03fa-4b6b-8e10-dbeed8967118'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:31.916835 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d2e58c77-03fa-4b6b-8e10-dbeed8967118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '946b7677835e43c69aca9858b9dd7565', 'request_id': 'req-d2e58c77-03fa-4b6b-8e10-dbeed8967118'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:31.929747 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d2e58c77-03fa-4b6b-8e10-dbeed8967118 admin admin] The token cache is being invalidate because project 946b7677835e43c69aca9858b9dd7565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:40:31.930097 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d2e58c77-03fa-4b6b-8e10-dbeed8967118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:31.930768 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-d2e58c77-03fa-4b6b-8e10-dbeed8967118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:31.932422 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 825/1657] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Sep 24 19:40:31 2022] DELETE /identity/v3/projects/946b7677835e43c69aca9858b9dd7565 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:40:41.580098 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=38,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:41.926329 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=78,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:34.587407 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37facd-ce0b-4508-9e12-6535372e328d admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:34.588828 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-5b37facd-ce0b-4508-9e12-6535372e328d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:34.656877 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37facd-ce0b-4508-9e12-6535372e328d admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:34.704681 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a5ff9-0c45-4049-aba2-e97ba8365384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:34.705210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a5ff9-0c45-4049-aba2-e97ba8365384 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:34.705486 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a5ff9-0c45-4049-aba2-e97ba8365384 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:34.705771 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a5ff9-0c45-4049-aba2-e97ba8365384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:34.707585 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2a4a5ff9-0c45-4049-aba2-e97ba8365384 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:34.785658 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a5ff9-0c45-4049-aba2-e97ba8365384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:34.787105 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a5ff9-0c45-4049-aba2-e97ba8365384 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:34.805040 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 833/1658] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:42:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:42:35.705638 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e58c77-03fa-4b6b-8e10-dbeed8967118 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:35.707180 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-d2e58c77-03fa-4b6b-8e10-dbeed8967118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:35.721789 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e58c77-03fa-4b6b-8e10-dbeed8967118 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:35.726095 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfc7c5-729d-43f7-bae4-6422431127bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:35.727242 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfc7c5-729d-43f7-bae4-6422431127bd service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:35.727368 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfc7c5-729d-43f7-bae4-6422431127bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:35.727542 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfc7c5-729d-43f7-bae4-6422431127bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:35.729356 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-36dfc7c5-729d-43f7-bae4-6422431127bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:35.747927 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfc7c5-729d-43f7-bae4-6422431127bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:35.750642 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfc7c5-729d-43f7-bae4-6422431127bd service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:35.759949 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 826/1659] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:42:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:42:35.805351 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a5ff9-0c45-4049-aba2-e97ba8365384 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:35.806518 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-2a4a5ff9-0c45-4049-aba2-e97ba8365384 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:35.816798 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a5ff9-0c45-4049-aba2-e97ba8365384 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:35.820363 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560ce7a-511d-451b-bb4b-b2a9c909b812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:35.820964 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560ce7a-511d-451b-bb4b-b2a9c909b812 service neutron] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:35.821245 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560ce7a-511d-451b-bb4b-b2a9c909b812 service neutron] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:35.821521 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560ce7a-511d-451b-bb4b-b2a9c909b812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:35.823227 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1560ce7a-511d-451b-bb4b-b2a9c909b812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:35.853694 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=100 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:35.905832 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560ce7a-511d-451b-bb4b-b2a9c909b812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:35.907299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1560ce7a-511d-451b-bb4b-b2a9c909b812 service neutron] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:35.927977 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 834/1660] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:42:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:42:37.125817 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfc7c5-729d-43f7-bae4-6422431127bd service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:37.135151 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfc7c5-729d-43f7-bae4-6422431127bd service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:37.138972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9696b-53a0-48e3-bad5-0a15da986eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:37.139702 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9696b-53a0-48e3-bad5-0a15da986eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:37.139984 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9696b-53a0-48e3-bad5-0a15da986eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:37.140258 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9696b-53a0-48e3-bad5-0a15da986eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:37.142081 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-23e9696b-53a0-48e3-bad5-0a15da986eb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:37.157365 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9696b-53a0-48e3-bad5-0a15da986eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:37.158887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9696b-53a0-48e3-bad5-0a15da986eb9 service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:37.172100 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 827/1661] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:42:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:42:38.254229 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560ce7a-511d-451b-bb4b-b2a9c909b812 service neutron] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:38.255860 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-1560ce7a-511d-451b-bb4b-b2a9c909b812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:38.271601 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560ce7a-511d-451b-bb4b-b2a9c909b812 service neutron] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:38.277189 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e925049-be8a-4812-aaea-1f61cbd5d3df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e5798be0fa544cf9cf48558e87fcfa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:38.277869 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e925049-be8a-4812-aaea-1f61cbd5d3df service nova] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:38.278210 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e925049-be8a-4812-aaea-1f61cbd5d3df service nova] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:38.278506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e925049-be8a-4812-aaea-1f61cbd5d3df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:38.281301 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-8e925049-be8a-4812-aaea-1f61cbd5d3df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:38.294352 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e925049-be8a-4812-aaea-1f61cbd5d3df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:38.296336 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e925049-be8a-4812-aaea-1f61cbd5d3df service nova] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:38.306920 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 835/1662] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:42:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:42:47.165973 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=12 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:48.302424 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=35 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:49.106857 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9696b-53a0-48e3-bad5-0a15da986eb9 service neutron] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:49.117622 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9696b-53a0-48e3-bad5-0a15da986eb9 service neutron] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:49.121299 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfedd4-ef67-40d7-9f52-c2161c8e2efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1763ed41f99a4778b3df6eebcc6d94e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:49.121888 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfedd4-ef67-40d7-9f52-c2161c8e2efd service neutron] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:49.122162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfedd4-ef67-40d7-9f52-c2161c8e2efd service neutron] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:49.122431 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfedd4-ef67-40d7-9f52-c2161c8e2efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:49.124407 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-5fcfedd4-ef67-40d7-9f52-c2161c8e2efd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:49.187460 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfedd4-ef67-40d7-9f52-c2161c8e2efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:49.188880 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfedd4-ef67-40d7-9f52-c2161c8e2efd service neutron] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:49.198124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 828/1663] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:42:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:42:51.965936 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21f828-44d5-44d3-a973-6a6eae1a7e3c None None] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:51.966417 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21f828-44d5-44d3-a973-6a6eae1a7e3c None None] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:51.966567 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21f828-44d5-44d3-a973-6a6eae1a7e3c None None] PATH_INFO: `/` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:51.968122 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 836/1664] 10.222.0.25 () {54 vars in 921 bytes} [Sat Sep 24 19:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:42:51.983613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47fb07-5657-4271-a660-0d05c74da6ce None None] REQUEST_METHOD: `POST` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:51.984124 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47fb07-5657-4271-a660-0d05c74da6ce None None] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:51.984512 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47fb07-5657-4271-a660-0d05c74da6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:52.006613 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.auth.core [None req-4a47fb07-5657-4271-a660-0d05c74da6ce None None] MFA Rules not processed for user `95a375bda898420fb9df08d514bf9bff`. Rule list: `[]` (Enabled: `True`). {{(pid=81421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:42:52.008334 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4a47fb07-5657-4271-a660-0d05c74da6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:52.084618 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 829/1665] 10.222.0.25 () {58 vars in 1018 bytes} [Sat Sep 24 19:42:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:42:52.234744 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21f828-44d5-44d3-a973-6a6eae1a7e3c None None] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:52.236661 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-cf21f828-44d5-44d3-a973-6a6eae1a7e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:52.257120 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21f828-44d5-44d3-a973-6a6eae1a7e3c None None] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:52.267757 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302589a7-4b3e-4e89-999c-1a47ab335f29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a375bda898420fb9df08d514bf9bff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:52.268793 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302589a7-4b3e-4e89-999c-1a47ab335f29 service placement] REQUEST_METHOD: `GET` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:52.269427 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302589a7-4b3e-4e89-999c-1a47ab335f29 service placement] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:52.270162 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302589a7-4b3e-4e89-999c-1a47ab335f29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:52.289304 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302589a7-4b3e-4e89-999c-1a47ab335f29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:52.292482 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302589a7-4b3e-4e89-999c-1a47ab335f29 service placement] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:52.310129 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 837/1666] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:42:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:42:55.455265 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47fb07-5657-4271-a660-0d05c74da6ce None None] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:55.457265 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-4a47fb07-5657-4271-a660-0d05c74da6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:55.474634 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47fb07-5657-4271-a660-0d05c74da6ce None None] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:55.479288 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708b759-4683-44ae-9b65-31a3ee519ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:55.479950 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708b759-4683-44ae-9b65-31a3ee519ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:55.480235 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708b759-4683-44ae-9b65-31a3ee519ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:55.480506 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708b759-4683-44ae-9b65-31a3ee519ec9 admin admin] PATH_INFO: `/v3/users/ea311a3ffec74f2285505b177504a75b` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:55.481735 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708b759-4683-44ae-9b65-31a3ee519ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea311a3ffec74f2285505b177504a75b)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:55.483891 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708b759-4683-44ae-9b65-31a3ee519ec9 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:55.538485 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0708b759-4683-44ae-9b65-31a3ee519ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea311a3ffec74f2285505b177504a75b'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:42:55.539144 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0708b759-4683-44ae-9b65-31a3ee519ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea311a3ffec74f2285505b177504a75b'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:42:55.548112 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0708b759-4683-44ae-9b65-31a3ee519ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea311a3ffec74f2285505b177504a75b'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:42:55.548930 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0708b759-4683-44ae-9b65-31a3ee519ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea311a3ffec74f2285505b177504a75b'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:42:55.565819 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-0708b759-4683-44ae-9b65-31a3ee519ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea311a3ffec74f2285505b177504a75b'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:42:55.581872 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 830/1667] 10.222.0.25 () {58 vars in 1224 bytes} [Sat Sep 24 19:42:55 2022] DELETE /identity/v3/users/ea311a3ffec74f2285505b177504a75b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:42:55.768643 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302589a7-4b3e-4e89-999c-1a47ab335f29 service placement] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:55.786808 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302589a7-4b3e-4e89-999c-1a47ab335f29 service placement] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:55.843366 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fcd95-318c-4e05-86f6-2ebc0dc4bf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:55.843988 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fcd95-318c-4e05-86f6-2ebc0dc4bf66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:55.844260 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fcd95-318c-4e05-86f6-2ebc0dc4bf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:55.844527 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fcd95-318c-4e05-86f6-2ebc0dc4bf66 admin admin] PATH_INFO: `/v3/projects/39d6e4e81862451998909c5eedfe9841` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:55.845646 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fcd95-318c-4e05-86f6-2ebc0dc4bf66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d6e4e81862451998909c5eedfe9841)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:55.847554 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fcd95-318c-4e05-86f6-2ebc0dc4bf66 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:55.892406 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-807fcd95-318c-4e05-86f6-2ebc0dc4bf66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d6e4e81862451998909c5eedfe9841', 'request_id': 'req-807fcd95-318c-4e05-86f6-2ebc0dc4bf66'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:42:55.897773 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-807fcd95-318c-4e05-86f6-2ebc0dc4bf66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d6e4e81862451998909c5eedfe9841', 'request_id': 'req-807fcd95-318c-4e05-86f6-2ebc0dc4bf66'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:42:55.903847 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-807fcd95-318c-4e05-86f6-2ebc0dc4bf66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d6e4e81862451998909c5eedfe9841', 'request_id': 'req-807fcd95-318c-4e05-86f6-2ebc0dc4bf66'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:42:55.916142 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-807fcd95-318c-4e05-86f6-2ebc0dc4bf66 admin admin] The token cache is being invalidate because project 39d6e4e81862451998909c5eedfe9841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:42:55.916371 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-807fcd95-318c-4e05-86f6-2ebc0dc4bf66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:42:55.916996 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-807fcd95-318c-4e05-86f6-2ebc0dc4bf66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:42:55.918488 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 838/1668] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Sep 24 19:42:55 2022] DELETE /identity/v3/projects/39d6e4e81862451998909c5eedfe9841 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:42:55.923181 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708b759-4683-44ae-9b65-31a3ee519ec9 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:55.924604 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-0708b759-4683-44ae-9b65-31a3ee519ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:55.932846 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:55.939965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708b759-4683-44ae-9b65-31a3ee519ec9 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:55.996065 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ed050-a7e1-47f6-9685-7978fb1a59b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:55.996691 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ed050-a7e1-47f6-9685-7978fb1a59b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:55.996971 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ed050-a7e1-47f6-9685-7978fb1a59b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:55.997243 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ed050-a7e1-47f6-9685-7978fb1a59b8 admin admin] PATH_INFO: `/v3/users/e8e3c1674e7043e690be2c09eb4e390a` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:56.010524 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ed050-a7e1-47f6-9685-7978fb1a59b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8e3c1674e7043e690be2c09eb4e390a)` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:56.012503 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ed050-a7e1-47f6-9685-7978fb1a59b8 admin admin] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:56.057726 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-b66ed050-a7e1-47f6-9685-7978fb1a59b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8e3c1674e7043e690be2c09eb4e390a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:42:56.058389 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-b66ed050-a7e1-47f6-9685-7978fb1a59b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8e3c1674e7043e690be2c09eb4e390a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:42:56.066212 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-b66ed050-a7e1-47f6-9685-7978fb1a59b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8e3c1674e7043e690be2c09eb4e390a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:42:56.066904 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-b66ed050-a7e1-47f6-9685-7978fb1a59b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8e3c1674e7043e690be2c09eb4e390a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:42:56.078887 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.notifications [None req-b66ed050-a7e1-47f6-9685-7978fb1a59b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8e3c1674e7043e690be2c09eb4e390a'} {{(pid=81421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:42:56.091780 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 831/1669] 10.222.0.25 () {58 vars in 1224 bytes} [Sat Sep 24 19:42:55 2022] DELETE /identity/v3/users/e8e3c1674e7043e690be2c09eb4e390a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:42:56.263436 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fcd95-318c-4e05-86f6-2ebc0dc4bf66 admin admin] Authenticating user token {{(pid=81420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:56.264896 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.fernet_utils [None req-807fcd95-318c-4e05-86f6-2ebc0dc4bf66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:56.278144 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fcd95-318c-4e05-86f6-2ebc0dc4bf66 admin admin] Validating token access rules against request {{(pid=81420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:56.335855 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346126e4-6d3d-491a-9a6a-59f9f5a8f337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a348fc63930b48c2bf96319b964824d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80330a20cbd94abd8d12b2c485818669', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:56.336508 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346126e4-6d3d-491a-9a6a-59f9f5a8f337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:56.336779 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346126e4-6d3d-491a-9a6a-59f9f5a8f337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:56.337043 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346126e4-6d3d-491a-9a6a-59f9f5a8f337 admin admin] PATH_INFO: `/v3/projects/5be6d60982e644fda7462ebd074df7b0` {{(pid=81420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:56.348285 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346126e4-6d3d-491a-9a6a-59f9f5a8f337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5be6d60982e644fda7462ebd074df7b0)` {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:56.350309 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346126e4-6d3d-491a-9a6a-59f9f5a8f337 admin admin] RBAC: Authorization granted {{(pid=81420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:56.361341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:56.398464 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-346126e4-6d3d-491a-9a6a-59f9f5a8f337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5be6d60982e644fda7462ebd074df7b0', 'request_id': 'req-346126e4-6d3d-491a-9a6a-59f9f5a8f337'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:42:56.404505 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-346126e4-6d3d-491a-9a6a-59f9f5a8f337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5be6d60982e644fda7462ebd074df7b0', 'request_id': 'req-346126e4-6d3d-491a-9a6a-59f9f5a8f337'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:42:56.411419 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-346126e4-6d3d-491a-9a6a-59f9f5a8f337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5be6d60982e644fda7462ebd074df7b0', 'request_id': 'req-346126e4-6d3d-491a-9a6a-59f9f5a8f337'} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:42:56.425523 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-346126e4-6d3d-491a-9a6a-59f9f5a8f337 admin admin] The token cache is being invalidate because project 5be6d60982e644fda7462ebd074df7b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:42:56.425809 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-346126e4-6d3d-491a-9a6a-59f9f5a8f337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:42:56.426419 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG keystone.notifications [None req-346126e4-6d3d-491a-9a6a-59f9f5a8f337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:42:56.427965 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: [pid: 81420|app: 0|req: 839/1670] 10.222.0.25 () {58 vars in 1233 bytes} [Sat Sep 24 19:42:56 2022] DELETE /identity/v3/projects/5be6d60982e644fda7462ebd074df7b0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:43:06.088248 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=57,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:43:06.422375 dv-osbrick-859195-1-iscsi devstack@keystone.service[81420]: DEBUG dbcounter [-] [81420] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:45:42.789875 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ed050-a7e1-47f6-9685-7978fb1a59b8 admin admin] Authenticating user token {{(pid=81421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:45:42.791343 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-b66ed050-a7e1-47f6-9685-7978fb1a59b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:45:42.859615 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ed050-a7e1-47f6-9685-7978fb1a59b8 admin admin] Validating token access rules against request {{(pid=81421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:45:42.921075 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61dbb91-2c7e-47fc-8479-356e68c77c87 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95a375bda898420fb9df08d514bf9bff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f61085f09512451e92c9fa36fa9a8071', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:45:42.921680 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dbb91-2c7e-47fc-8479-356e68c77c87 service placement] REQUEST_METHOD: `GET` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:45:42.921954 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dbb91-2c7e-47fc-8479-356e68c77c87 service placement] SCRIPT_NAME: `/identity` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:45:42.922220 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dbb91-2c7e-47fc-8479-356e68c77c87 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:45:42.923975 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.fernet_utils [None req-c61dbb91-2c7e-47fc-8479-356e68c77c87 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:45:42.934972 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61dbb91-2c7e-47fc-8479-356e68c77c87 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:45:42.936531 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61dbb91-2c7e-47fc-8479-356e68c77c87 service placement] RBAC: Authorization granted {{(pid=81421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:45:42.946341 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: [pid: 81421|app: 0|req: 832/1671] 10.222.0.25 () {60 vars in 1365 bytes} [Sat Sep 24 19:45:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:45:52.942350 dv-osbrick-859195-1-iscsi devstack@keystone.service[81421]: DEBUG dbcounter [-] [81421] Writing DB stats keystone:SELECT=58 {{(pid=81421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}